Detection Engineering Dispatch

Detection Dispatch Episode 52: Prompted to Fail: When LLMs Go Rogue


Listen Later

LLMs are rewriting the rules of app security—and not always in a good way.

In this episode Alex sits down with Scott Rogers, a seasoned data scientist at ANvilogic to unpack why LLMs are the new wild west of application risk—and how old-school OWASP principles are making a serious comeback.

We cover:

  • Real-world prompt injection failures (yes, including Air Canada’s rogue chatbot)
  • How RAG systems can accidentally leak sensitive data
  • Why GenAI risk ≠ traditional appsec—but it rhymes
  • How classic tools like SAST, DAST, and logs can still save your bacon

Whether you're threat modeling your first LLM system or already knee-deep in GenAI, this episode is full of spicy detection ideas, war stories, and practical advice you won’t want to miss.

Stay in the loop! Connect with us:

  • Join Dispatch Community: https://www.anvilogic.com/workshop
  • Website: https://www.anvilogic.com/
  • LinkedIn: https://www.linkedin.com/company/anvilogic 
  • YouTube: https://www.youtube.com/@Anvilogic 

About Detection Engineering Dispatch
Detection Engineering Dispatch is a live series featuring open discussions and live case studies with security operations teams at leading companies on what it takes to build a great detection engineering program. Join your peers to share knowledge, deep dive into technical best practices, and engage in discussions relevant to the detection engineering community.

...more
View all episodesView all episodes
Download on the App Store

Detection Engineering DispatchBy Anvilogic