AI Security Ops

AI Security Ops

By Black Hills Information SecurityNewsEducationTech News
Download on the App Store

AI Security Ops episodes

  • Azure AI Foundry Guardrails | Episode 27

    🔗 Register for FREE Infosec Webcasts, Anti-casts & Summits – 

    https://poweredbybhis.com


    Azure AI Foundry Guardrails | Episode 27

    In this episode of BHIS Presents: AI Security Ops, we explore how to configure content filters for AI models using the Azure AI Fooundry guardrails and controls interface. Whether you're building secure demos or deploying models in production, this walkthrough shows how to block unwanted content, enforce policy, and maintain compliance.

    Topics Covered:

    •  Changing default filters for demo compliance
    •  Setting up a system prompt and understanding its role
    •  Adding regex terms to block specific content
    •  Creating and configuring a custom filter: “tech demo guardrails”
    •  Input-side filtering: inspecting user text before model access
    •  Safety vs. security categories in filtering
    •  Enabling prompt shields for indirect jailbreak detection


    This video is ideal for developers, security engineers, and anyone working with AI systems who needs to implement layered defenses and ensure responsible model behavior.


    Why This Matters
    By implementing layered security—block lists, input and output filters—you protect sensitive data, comply with policy, and maintain a safe user experience.

    #AIsecurity #GuardrailsAndControls #ContentFiltering #PromptSecurity #RegexFiltering #BHIS #AIModelSafety #SystemPromptSecurity

    Brought to you by Black Hills Information Security 

    https://www.blackhillsinfosec.com


    ----------------------------------------------------------------------------------------------

    Joff Thyer - https://blackhillsinfosec.com/team/joff-thyer/

    Derek Banks - https://www.blackhillsinfosec.com/team/derek-banks/

    Brian Fehrman - https://www.blackhillsinfosec.com/team/brian-fehrman/

    Bronwen Aker - http://blackhillsinfosec.com/team/bronwen-aker/

    Ben Bowman - https://www.blackhillsinfosec.com/team/ben-bowman/

    • (00:00) - Introduction & Overview
  • (01:17) - Changing the Default Content Filter for Demo Compliance
  • (02:00) - Setting Up a System Prompt and Its Purpose
  • (04:26) - Adding a New Term (“dogs”) to the Content Filter (Regex Example)
  • (05:04) - Creating and Configuring a Content Filter Named “Tech Demo Guardrails”
  • (05:35) - How Input-Side Filters Inspect and Block Unwanted Content
  • (06:01) - Overview of Safety Categories vs. Security Categories
  • (07:15) - Enabling Prompt Shields for Indirect Jailbreak Detection (Not Used in Demo)
  • (08:30) - Summary & Next Steps
  • 16 min
  • Questions from the Community | Episode 26

    🔗 Register for FREE Infosec Webcasts, Anti-casts & Summits – 

    https://poweredbybhis.com


    Questions from the Community | Episode 26
    In this community-driven episode of BHIS Presents: AI Security Ops, the panel answers real questions from viewers about AI security, privacy, and risk. Featuring Brian Fehrman, Bronwen Aker, Jack Verrier, and Joff Thyer, the team dives into everything from guardrails and hallucinations to GDPR, agentic AI, and how to stay safe in an AI-saturated world.

    💬 Topics include:

    • Are guardrails enough to protect sensitive prompts?
    • What’s the difference between hallucination and confabulation?
    • How does AI intersect with GDPR and the right to be forgotten?
    • What does it mean to “stay safe” when using AI?
    • How is securing AI different from traditional software?


    Whether you're a red teamer, SOC analyst, or just trying to navigate the AI landscape, this episode offers practical insights and thoughtful perspectives from seasoned security professionals.

    Panelists:
    🔹 Brian Fehrman
    🔹 Bronwen Aker
    🔹 Jack Verrier
    🔹 Joff Thyer
    #AIsecurity #Cybersecurity #PromptInjection #LLMs #BHIS #AIprivacy #AgenticAI #AIandGDPR

    Brought to you by Black Hills Information Security 

    https://www.blackhillsinfosec.com


    ----------------------------------------------------------------------------------------------

    Joff Thyer - https://blackhillsinfosec.com/team/joff-thyer/

    Derek Banks - https://www.blackhillsinfosec.com/team/derek-banks/

    Brian Fehrman - https://www.blackhillsinfosec.com/team/brian-fehrman/

    Bronwen Aker - http://blackhillsinfosec.com/team/bronwen-aker/

    Ben Bowman - https://www.blackhillsinfosec.com/team/ben-bowman/

    • (00:00) - Intro & Panel Welcome
  • (01:22) - Are Guardrails Enough to Protect System Prompts?
  • (09:54) - Explaining Hallucination vs. Confabulation
  • (20:09) - AI and GDPR: The Right to Be Forgotten?
  • (23:49) - How Do We Stay Safe Using AI?
  • (32:26) - Securing AI vs. Traditional Software
  • (37:18) - Final Thoughts & Wrap-Up
  • 38 min
  • AI News Stories | Episode 25

    🔗 Register for FREE Infosec Webcasts, Anti-casts & Summits – 

    https://poweredbybhis.com


    AI News Stories | Episode 25
    In this episode of BHIS Presents: AI Security Ops, the panel dives into the biggest AI cybersecurity headlines from late September 2025. From government regulation to zero-click exploits, we unpack the risks, trends, and implications for security professionals navigating the AI-powered future.

    🧠 Topics Covered:

    • Government oversight of advanced AI systems
    • Accenture’s massive layoffs amid AI pivot
    • ShadowLeak: zero-click vulnerability in ChatGPT agents
    • Malicious MCP server stealing emails
    • AI in the SOC: benefits and risks
    • Attackers using AI to scale ransomware and social engineering


    Whether you're a red teamer, SOC analyst, or just trying to stay ahead of AI threats, this episode delivers sharp insights and practical takeaways.


    Brought to you by Black Hills Information Security 

    https://www.blackhillsinfosec.com

    ----------------------------------------------------------------------------------------------

    Joff Thyer - https://blackhillsinfosec.com/team/joff-thyer/

    Derek Banks - https://www.blackhillsinfosec.com/team/derek-banks/

    Brian Fehrman - https://www.blackhillsinfosec.com/team/brian-fehrman/

    Bronwen Aker - http://blackhillsinfosec.com/team/bronwen-aker/

    Ben Bowman - https://www.blackhillsinfosec.com/team/ben-bowman/

    • (00:00) - Intro & Sponsor Shoutouts
  • (00:45) - Senators Introduce AI Risk Evaluation Act
  • (09:48) - Accenture Layoffs & AI Restructuring
  • (16:17) - ShadowLeak: Zero-Click Vulnerability in ChatGPT
  • (20:07) - Malicious MCP Server & Supply Chain Risks
  • (26:27) - AI in the SOC: Alert Triage & Analyst Burnout
  • (30:10) - Final Thoughts: AI’s Role in Security Operations
  • 32 min
  • Model Extraction Attacks | Episode 24

    🔗 Register for FREE Infosec Webcasts, Anti-casts & Summits – 

    https://poweredbybhis.com


    Model Extraction Attacks | Episode 24
    In this solo episode of BHIS Presents: AI Security Ops, Brian Fehrman explores the stealthy world of Model Extraction Attacks—where hackers clone your AI model without ever touching your code. Learn how adversaries can reverse-engineer your multimillion-dollar model simply by querying its API, and why this threat is more than just academic.

    We break down:
    - What model extraction is and how it works
    - Real-world examples like DeepSeek’s alleged distillation of OpenAI models
    - The risks to intellectual property, security, and sensitive data
    - Defensive strategies including API throttling, output limiting, watermarking, and honeypots
    - Legal and ethical questions around benchmarking vs. theft

    Whether you're deploying LLMs or classification models, this episode will help you understand how attackers replicate model behavior—and what you can do to stop them.
    If your AI is accessible, someone’s probably trying to copy it.


    #AIsecurity #ModelExtractionAttacks #Cybersecurity #BHIS #LLMsecurity #AIthreats


    ----------------------------------------------------------------------------------------------

    Joff Thyer - https://blackhillsinfosec.com/team/joff-thyer/

    Derek Banks - https://www.blackhillsinfosec.com/team/derek-banks/

    Brian Fehrman - https://www.blackhillsinfosec.com/team/brian-fehrman/

    Bronwen Aker - http://blackhillsinfosec.com/team/bronwen-aker/

    Ben Bowman - https://www.blackhillsinfosec.com/team/ben-bowman/

    • (00:00) - Intro & Sponsor Shoutouts
  • (01:19) - What Is a Model Extraction Attack?
  • (02:45) - Why Training a Model Is So Expensive
  • (05:42) - How Model Extraction Works
  • (07:11) - Why It Matters: IP, Security & Data Risks
  • (10:25) - What Makes Extraction Easier or Harder
  • (12:54) - Defenses: Monitoring, Watermarking & Privacy
  • (16:04) - What to Do If You Suspect an Attack
  • (16:29) - Legal & Ethical Questions Around Model Theft
  • (19:30) - Final Thoughts & Takeaways
  • 20 min
  • News of the Month | Episode 23

    🔗 Register for FREE Infosec Webcasts, Anti-casts & Summits – 

    https://poweredbybhis.com



    In this episode of AI Security Ops, Brian Fehrman and Joff Thyer dive into the latest AI news of the month, exploring how rapidly evolving technologies are reshaping cybersecurity.
    Topics covered include:
     - How AI is changing cybersecurity monitoring
     - Expanding from email to Slack, Teams, and other chat platforms
     - Addressing insider threats and phishing campaigns in new channels
     - The rapid pace of AI innovation and industry trends
     - Why organizations should prioritize AI security assessments
     - Real-world risks and opportunities in the AI landscape

    Stay ahead in the AI race with Black Hills Information Security as we cover real-world risks, opportunities, and the latest developments in the AI landscape.


    ///News Stories This Episode:

    1. AI-Powered Villager Pen Testing Tool Hits 11,000 PyPI Downloads Amid Abuse Concerns
    https://thehackernews.com/2025/09/ai-powered-villager-pen-testing-tool.html

    2. CrowdStrike and Meta Just Made Evaluating AI Security Tools Easier
    https://www.zdnet.com/article/crowdstrike-and-meta-just-made-evaluating-ai-security-tools-easier/

    3. Check Point Acquires Lakera to Deliver End-to-End AI Security for Enterprises
    https://www.checkpoint.com/press-releases/check-point-acquires-lakera-to-deliver-end-to-end-ai-security-for-enterprises/

    4. Proofpoint Offers AI Agents to Monitor Human-Based Communications
    https://www.msspalert.com/news/proofpoint-offers-ai-agents-to-monitor-human-based-communications

    5. EvilAI Malware Campaign Exploits AI-Generated Code to Breach Global Critical Sectors
    https://industrialcyber.co/ransomware/evilai-malware-campaign-exploits-ai-generated-code-to-breach-global-critical-sectors/

    ----------------------------------------------------------------------------------------------

    Joff Thyer - https://blackhillsinfosec.com/team/joff-thyer/

    Derek Banks - https://www.blackhillsinfosec.com/team/derek-banks/

    Brian Fehrman - https://www.blackhillsinfosec.com/team/brian-fehrman/

    Bronwen Aker - http://blackhillsinfosec.com/team/bronwen-aker/

    Ben Bowman - https://www.blackhillsinfosec.com/team/ben-bowman/

    35 min
  • Insider Threat 2.0 - Prompt Leaks & Shadow AI | Episode 22

    🔗 Register for FREE Infosec Webcasts, Anti-casts & Summits – 

    https://poweredbybhis.com


    Insider Threat 2.0 -  Prompt Leaks & Shadow AI | Episode 22

    In this episode of BHIS Presents AI Security Ops, we dive into Insider Threat 2.0: Prompt Leaks & Shadow AI. The panel explores the hidden risks of employees pasting sensitive data into public AI tools, the rise of unauthorized “Shadow AI” in organizations, and how policies—or lack thereof—can expose critical information. Learn why free AI services often make you the product, how prompt history creates data leakage risks, and why companies must establish clear AI usage guidelines. We also cover practical defenses, from enterprise AI accounts to cultural awareness training, and draw parallels to past IT challenges like Shadow IT and rogue wireless.
    If you’re concerned about AI security, data leakage, or safe adoption of large language models, this discussion will help you navigate the risks and protect your organization.

    #AIsecurity #PromptInjection #ShadowAI #Cybersecurity #BHIS


    ----------------------------------------------------------------------------------------------

    Joff Thyer - https://blackhillsinfosec.com/team/joff-thyer/

    Derek Banks - https://www.blackhillsinfosec.com/team/derek-banks/

    Brian Fehrman - https://www.blackhillsinfosec.com/team/brian-fehrman/

    Bronwen Aker - http://blackhillsinfosec.com/team/bronwen-aker/

    Ben Bowman - https://www.blackhillsinfosec.com/team/ben-bowman/

    26 min
  • Deepfakes and Fraudulent Interviews In Remote Hiring | Episode 21

    🔗 Register for FREE Infosec Webcasts, Anti-casts & Summits – 

    https://poweredbybhis.com


    Episode 21 - Deepfakes And Fraudulent Interviews In Remote Hiring


    In this episode of AI Security Ops by Black Hills Information Security, the crew explores the alarming rise of deepfakes and fraudulent interviews in remote hiring. As virtual work expands, cybercriminals are using AI-driven impersonation tactics to pose as job candidates, deceive recruiters, and gain unauthorized access to organizations. Joff, Bronwen Aker, Brian Fehrman, and Derek Banks break down real-world cases, explain the challenges of spotting deepfake job scams, and share actionable strategies to secure hiring processes. Discover the red flags to watch for in virtual interviews, how attackers exploit trust, and why companies must adapt their security awareness in the age of AI.


    ----------------------------------------------------------------------------------------------

    Joff Thyer - https://blackhillsinfosec.com/team/joff-thyer/

    Derek Banks - https://www.blackhillsinfosec.com/team/derek-banks/

    Brian Fehrman - https://www.blackhillsinfosec.com/team/brian-fehrman/

    Bronwen Aker - http://blackhillsinfosec.com/team/bronwen-aker/

    Ben Bowman - https://www.blackhillsinfosec.com/team/ben-bowman/

    29 min
  • The Hallucination Problem | Episode 20

    🔗 Register for FREE Infosec Webcasts, Anti-casts & Summits – 

    https://poweredbybhis.com


    Episode 20 - The Hallucination Problem


    In this episode of AI Security Ops, Joff Thyer and Brian Fehrman from Black Hills Information Security dive into the hallucination problem in AI large language models and generative AI. 


    They explain what hallucinations are, why they happen, and the risks they create in real-world AI deployments. The discussion covers security implications, practical examples, and strategies organizations can use to mitigate these issues through stronger design, monitoring, and testing. 


    A must-watch for cybersecurity professionals, AI researchers, and anyone curious about the limitations and challenges of modern AI systems.


    ----------------------------------------------------------------------------------------------

    Joff Thyer - https://blackhillsinfosec.com/team/joff-thyer/

    Derek Banks - https://www.blackhillsinfosec.com/team/derek-banks/

    Brian Fehrman - https://www.blackhillsinfosec.com/team/brian-fehrman/

    Bronwen Aker - http://blackhillsinfosec.com/team/bronwen-aker/

    Ben Bowman - https://www.blackhillsinfosec.com/team/ben-bowman/

    27 min
  • News of the Month | Episode 19

    Register for FREE Infosec Webcasts, Anti-casts & Summits –
    https://poweredbybhis.com

    AI News of the Month | Episode 19

    In Episode 19,Brianand Derek cover a zero-click indirect prompt injection attack against ChatGPT connectors and seemingly innocent Google Calendar events that hijack smart homes via Gemini, with possible consequences for the power grid.

    They'll discuss the impact of Microsoft patching a critical Azure OpenAI SSRF vulnerability and go over new NIST AI security standards, IBM’s study on shadow AI and breach costs, OpenAI’s response to chat indexing leaks, and a malicious VS Code extension that stole $500K in cryptocurrency. 

    #AI #CyberSecurity #PromptInjection #Malware #InfoSec #AIThreats #Hacking #GenerativeAI #Deepfakes #LLM #ShadowAI

    • “Poisoned doc” exfiltrates data via ChatGPT Connectors (AgentFlayer) — Aug 6, 2025
      • Primary: https://www.wired.com/story/poisoned-document-could-leak-secret-data-chatgpt/
      • Tech write-up: https://labs.zenity.io/p/agentflayer-chatgpt-connectors-0click-attack-5b41


    • Poisoned Google Calendar invite hijacks Gemini to control a smart home — Aug 6–10, 2025
      • Primary: https://www.wired.com/story/google-gemini-calendar-invite-hijack-smart-home/
      • Bug/patch coverage: https://www.bleepingcomputer.com/news/security/google-calendar-invites-let-researchers-hijack-gemini-to-leak-user-data/


    • Microsoft August Patch Tuesday adds AI-surface fixes; critical Azure OpenAI vuln (CVE-2025-53767) — Aug 12–13, 2025
      • Release coverage: https://www.techradar.com/pro/security/microsofts-latest-major-patch-fixes-a-serious-zero-day-flaw-and-a-host-of-other-issues-so-update-now
      • CVE entry: https://nvd.nist.gov/vuln/detail/CVE-2025-53767 (NVD)
      • Overview: https://www.tenable.com/blog/microsofts-august-2025-patch-tuesday-addresses-107-cves-cve-2025-53779 (Tenable®)


    • NIST proposes SP 800-53 “Control Overlays for Securing AI Systems” — Aug 14, 2025
      • Announcement: https://www.nist.gov/news-events/news/2025/08/nist-releases-control-overlays-securing-ai-systems-concept-paper
      • Concept paper (PDF): https://csrc.nist.gov/csrc/media/Projects/cosais/documents/NIST-Overlays-SecuringAI-concept-paper.pdf


    • IBM 2025 “Cost of a Data Breach”: AI is both breach vector and defender — Jul 30, 2025
      • Press release: https://newsroom.ibm.com/2025-07-30-ibm-report-13-of-organizations-reported-breaches-of-ai-models-or-applications%2C-97-of-which-reported-lacking-proper-ai-access-controls
      • Report: https://www.ibm.com/reports/data-breach
      • Analysis: https://venturebeat.com/security/ibm-shadow-ai-breaches-cost-670k-more-97-of-firms-lack-controls/ (VentureBeat)


    • OpenAI considers encrypting Temporary Chats; privacy clean-ups after search-indexing scare — Aug 18, 2025
      • Interview: https://www.axios.com/2025/08/18/altman-openai-chatgpt-encrypted-chats
      • Context: https://arstechnica.com/tech-policy/2025/08/chatgpt-users-shocked-to-learn-their-chats-were-in-google-search-results/
      • Help center (retention): https://help.openai.com/en/articles/8914046-temporary-chat-faq


    • Fake VS Code extension for Cursor leads to $500K crypto theft — July 11, 2025
      • Primary: https://www.scworld.com/news/fake-visual-studio-code-extension-for-cursor-led-to-500k-theft SC Media
      • Research write-up: https://securelist.com/open-source-package-for-cursor-ai-turned-into-a-crypto-heist/116908/Securelist
      • Coverage: https://www.bleepingcomputer.com/news/security/malicious-vscode-extension-in-cursor-ide-led-to-500k-crypto-theft/


    ----------------------------------------------------------------------------------------------
    Joff Thyer - https://blackhillsinfosec.com/team/joff-thyer/
    Derek Banks - https://www.blackhillsinfosec.com/team/derek-banks/
    Brian Fehrman - https://www.blackhillsinfosec.com/team/brian-fehrman/
    Bronwen Aker - http://blackhillsinfosec.com/team/bronwen-aker/
    Ben Bowman - https://www.blackhillsinfosec.com/team/ben-bowman/

    • (00:00) - Intro
  • (00:31) - “Poisoned doc” exfiltrates data via ChatGPT Connectors (AgentFlayer)
  • (01:15) - A zero-click prompt injection
  • (02:12) - url_safe bypassed using URLs from Microsoft’s Azure Blob cloud storage
  • (07:08) - Poisoned Google Calendar invite hijacks Gemini to control a smart home
  • (08:35) - The intersection of AI and IOT
  • (09:53) - Be careful what you hook AI up to
  • (10:23) - Derek warns of threat to power grid
  • (11:54) - Mitigations - restrict permissions, sanitize calendar content
  • (13:56) - Patch Tuesday - AI-surface fixes; critical Azure OpenAI vuln
  • (15:49) - NIST proposes SP 800-53 “Control Overlays for Securing AI Systems”
  • (18:43) - IBM “Cost of a Data Breach”: AI is both breach vector and defender
  • (19:16) - Shadow AI
  • (21:49) - “The AI adoption curve is outpacing controls”
  • (23:02) - OpenAI considers encrypting Temporary Chats
  • (26:39) - Data storage and logging LLM interactions
  • (29:59) - Fake VS Code extension for Cursor leads to $500K crypto theft
  • (30:37) - Danger of using pip install as root on a server
  • 38 min
  • Malware in the Age of AI | EP 18

    🔗 Register for FREE Infosec Webcasts, Anti-casts & Summits – 

    https://poweredbybhis.com


    Malware in the Age of AI | Episode 18

    In Episode 18, hosts Joff Thyer, Derek Banks and Brian Fehrman discuss the rise of AI-powered malware. From polymorphic keyloggers like Black Mamba to the use of ChatGPT, WormGPT, and fine-tuned LLMs for cyberattacks, the team will explain how generative AI is reshaping the security landscape.

    They'll break down the real risks vs. hype, including prompt injection, jailbreaking, deepfakes, and AI-driven fraud, while also sharing strategies defenders can use to fight back.

    The discussion highlights both the ethical implications and the critical need for defense-in-depth as threat actors use AI to accelerate their attacks.


    #AI #Cybersecurity #Malware #AIThreats #Deepfakes #LLM #InfoSec #AIinSecurity #GenerativeAI #Hacking


    ----------------------------------------------------------------------------------------------

    Joff Thyer - https://blackhillsinfosec.com/team/joff-thyer/

    Derek Banks - https://www.blackhillsinfosec.com/team/derek-banks/

    Brian Fehrman - https://www.blackhillsinfosec.com/team/brian-fehrman/

    Bronwen Aker - http://blackhillsinfosec.com/team/bronwen-aker/

    Ben Bowman - https://www.blackhillsinfosec.com/team/ben-bowman/

    • (00:00) - Intro
  • (01:15) - Black Mamba polymorphic AI keylogger
  • (02:47) - Can Chat GPT5 generate malware for us?
  • (03:42) - Guardrail circumvention technique #1
  • (04:16) - Guardrail circumvention technique #2
  • (05:30) - Guardrail circumvention technique #3
  • (05:59) - Guardrail circumvention technique #4
  • (06:30) - Using an Abliterated Model
  • (08:32) - AI models have democratized software creation
  • (11:20) - Polymorphic keyloggers are not new
  • (12:03) - AI makes it faster to iterate polymorphic malware
  • (12:33) - AI is able to analyze source code and find more vulnerabilities
  • (15:16) - How scared should we be? (hype vs reality)
  • (16:10) - Knowing enough to ask the right questions is important
  • (17:41) - Significant risks of AI fraud and social engineering
  • (19:32) - Business email compromise
  • (21:10) - How defenders can use AI
  • (24:28) - Audio deepfakes have become easier to create
  • (25:06) - Ethical concerns for pentesters using AI
  • (29:26) - In one sentence, how will AI change malware production in the near future?
  • 33 min

About AI Security Ops

From the publisher's feed

Join in on weekly podcasts that aim to illuminate how AI transforms cybersecurity—exploring emerging threats, tools, and trends—while equipping viewers with knowledge they can use practically (e.g.,…