The AWS Developers Podcast

5 Lessons Running AI Agents in Production


Listen Later

John Sexton and Aaron Tummon from Genesys join the show to share hard-won lessons from building and operating Cloud Copilot — an agentic AI layer serving 2 million users across 21+ AWS regions. Genesys powers customer experience for brands like Virgin Atlantic, Vodafone, and HSBC, and their copilot helps admins, supervisors, and agents work more efficiently through natural language. We cover the migration from Bedrock Inline Agents to Strands Agents, multi-agent orchestration with agents-as-tools, context management strategies, cost optimization, and the testing discipline required to keep agentic systems stable at scale. The 5 lessons: 1. Pick a framework that scales with you — Bedrock Inline Agents worked for 12–15 tools but became exponentially flakier beyond that. Strands Agents gave sensible defaults and room to grow without pinch points. 2. Separate orchestration from domain logic — Agents-as-tools creates a clean line between the orchestrator and sub-agents. You can pull functionality in and out per persona without destabilizing the system, and domain teams own their sub-agents independently. 3. Manage context aggressively — Long context windows for the orchestrator, stateless sub-agents, summarizing and sliding-window conversation managers, and strict control over what tools return. Every extra token in context degrades quality and increases cost. 4. Make prompt caching non-negotiable — System prompts, tool definitions, and conversation history rarely change between invocations. Enabling prompt caching delivered significant cost reductions with almost no effort. 5. Test relentlessly because prompt drift is invisible — One prompt change is never a breaking change; five accumulated changes are. A dedicated weekly Sentinel role investigates failures, and full test suites run on every single change.

With Aaron Tummon, Software Engineer at Genesys ; With John Sexton, Engineering Manager at Genesys

    • Genesys Cloud — Customer Experience Platform
      Strands Agents SDK — Open-Source AI Agent Framework
      Strands Agents — Agent Evaluation SDK
      Amazon Bedrock — Prompt Caching
      AWS Lambda — Serverless Compute
      Aaron Tummon on LinkedIn
      John Sexton on LinkedIn
      Thinking, Fast and Slow — Daniel Kahneman (Aaron's Book Pick)
      Mythos — Stephen Fry (John's Book Pick)
  • ...more
    View all episodesView all episodes
    Download on the App Store

    The AWS Developers PodcastBy Amazon Web Services

    • 4.7
    • 4.7
    • 4.7
    • 4.7
    • 4.7

    4.7

    24 ratings


    More shows like The AWS Developers Podcast

    View all
    The Daily by The New York Times

    The Daily

    111,948 Listeners

    Practical AI by Practical AI LLC

    Practical AI

    208 Listeners

    AWS Podcast by Amazon Web Services

    AWS Podcast

    203 Listeners

    Le podcast đŸŽ™ïž AWS ☁ en đŸ‡«đŸ‡· by Amazon Web Services

    Le podcast đŸŽ™ïž AWS ☁ en đŸ‡«đŸ‡·

    0 Listeners