Vanishing Gradients

Episode 59: Patterns and Anti-Patterns For Building with AI


Listen Later

John Berryman (Arcturus Labs; early GitHub Copilot engineer; co-author of Relevant Search and Prompt Engineering for LLMs) has spent years figuring out what makes AI applications actually work in production. In this episode, he shares the “seven deadly sins” of LLM development — and the practical fixes that keep projects from stalling.

From context management to retrieval debugging, John explains the patterns he’s seen succeed, the mistakes to avoid, and why it helps to think of an LLM as an “AI intern” rather than an all-knowing oracle.

We talk through:

  • Why chasing perfect accuracy is a dead end
  • How to use agents without losing control
  • Context engineering: fitting the right information in the window
  • Starting simple instead of over-orchestrating
  • Separating retrieval from generation in RAG
  • Splitting complex extractions into smaller checks
  • Knowing when frameworks help — and when they slow you down
  • A practical guide to avoiding the common traps of LLM development and building systems that actually hold up in production.

    LINKS:

    • Context Engineering for AI Agents, a free, upcoming lightning lesson from John and Hugo
    • The Hidden Simplicity of GenAI Systems, a previous lightning lesson from John and Hugo
    • Roaming RAG – RAG without the Vector Database, by John
    • Cut the Chit-Chat with Artifacts, by John
    • Prompt Engineering for LLMs by John and Albert Ziegler
    • Relevant Search by John and Doug Turnbull
    • Arcturus Labs
    • Watch the podcast on YouTube
    • Upcoming Events on Luma
    • 🎓 Learn more:

      • Hugo's course (this episode was a guest Q&A from the course): Building LLM Applications for Data Scientists and Software Engineershttps://maven.com/s/course/d56067f338
      • ...more
        View all episodesView all episodes
        Download on the App Store

        Vanishing GradientsBy Hugo Bowne-Anderson

        • 5
        • 5
        • 5
        • 5
        • 5

        5

        11 ratings


        More shows like Vanishing Gradients

        View all
        Data Skeptic by Kyle Polich

        Data Skeptic

        477 Listeners

        a16z Podcast by Andreessen Horowitz

        a16z Podcast

        1,083 Listeners

        The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

        The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

        434 Listeners

        Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

        Super Data Science: ML & AI Podcast with Jon Krohn

        301 Listeners

        NVIDIA AI Podcast by NVIDIA

        NVIDIA AI Podcast

        342 Listeners

        DataFramed by DataCamp

        DataFramed

        268 Listeners

        Practical AI by Practical AI LLC

        Practical AI

        211 Listeners

        Google DeepMind: The Podcast by Hannah Fry

        Google DeepMind: The Podcast

        194 Listeners

        Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

        Machine Learning Street Talk (MLST)

        89 Listeners

        Dwarkesh Podcast by Dwarkesh Patel

        Dwarkesh Podcast

        489 Listeners

        No Priors: Artificial Intelligence | Technology | Startups by Conviction

        No Priors: Artificial Intelligence | Technology | Startups

        131 Listeners

        Latent Space: The AI Engineer Podcast by swyx + Alessio

        Latent Space: The AI Engineer Podcast

        97 Listeners

        AI + a16z by a16z

        AI + a16z

        33 Listeners

        High Signal: Data Science | Career | AI by Delphina

        High Signal: Data Science | Career | AI

        18 Listeners

        OpenAI Podcast by OpenAI

        OpenAI Podcast

        52 Listeners