Vanishing Gradients

Episode 43: Tales from 400+ LLM Deployments: Building Reliable AI Agents in Production


Listen Later

Hugo speaks with Alex Strick van Linschoten, Machine Learning Engineer at ZenML and creator of a comprehensive LLMOps database documenting over 400 deployments. Alex's extensive research into real-world LLM implementations gives him unique insight into what actually works—and what doesn't—when deploying AI agents in production.

In this episode, we dive into:

  • The current state of AI agents in production, from successes to common failure modes
  • Practical lessons learned from analyzing hundreds of real-world LLM deployments
  • How companies like Anthropic, Klarna, and Dropbox are using patterns like ReAct, RAG, and microservices to build reliable systems
  • The evolution of LLM capabilities, from expanding context windows to multimodal applications
  • Why most companies still prefer structured workflows over fully autonomous agents
  • We also explore real-world case studies of production hurdles, including cascading failures, API misfires, and hallucination challenges. Alex shares concrete strategies for integrating LLMs into your pipelines while maintaining reliability and control.

    Whether you're scaling agents or building LLM-powered systems, this episode offers practical insights for navigating the complex landscape of LLMOps in 2025.

    LINKS

    • The podcast livestream on YouTube
    • The LLMOps database
    • All blog posts about the database
    • Anthropic's Building effective agents essay
    • Alex on LinkedIn
    • Hugo on twitter
    • Vanishing Gradients on twitter
    • Vanishing Gradients on YouTube
    • Vanishing Gradients on Twitter
    • Vanishing Gradients on Lu.ma
    • ...more
      View all episodesView all episodes
      Download on the App Store

      Vanishing GradientsBy Hugo Bowne-Anderson

      • 5
      • 5
      • 5
      • 5
      • 5

      5

      11 ratings


      More shows like Vanishing Gradients

      View all
      a16z Podcast by Andreessen Horowitz

      a16z Podcast

      1,001 Listeners

      Data Skeptic by Kyle Polich

      Data Skeptic

      470 Listeners

      Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

      Super Data Science: ML & AI Podcast with Jon Krohn

      296 Listeners

      DataFramed by DataCamp

      DataFramed

      269 Listeners

      Practical AI by Practical AI LLC

      Practical AI

      190 Listeners

      Last Week in AI by Skynet Today

      Last Week in AI

      281 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      88 Listeners

      Dwarkesh Podcast by Dwarkesh Patel

      Dwarkesh Podcast

      354 Listeners

      No Priors: Artificial Intelligence | Technology | Startups by Conviction

      No Priors: Artificial Intelligence | Technology | Startups

      125 Listeners

      This Day in AI Podcast by Michael Sharkey, Chris Sharkey

      This Day in AI Podcast

      190 Listeners

      Latent Space: The AI Engineer Podcast by swyx + Alessio

      Latent Space: The AI Engineer Podcast

      63 Listeners

      The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

      The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

      424 Listeners

      The Next Wave - AI and The Future of Technology by Hubspot Media

      The Next Wave - AI and The Future of Technology

      57 Listeners

      Training Data by Sequoia Capital

      Training Data

      36 Listeners

      High Signal: Data Science | Career | AI by Delphina

      High Signal: Data Science | Career | AI

      4 Listeners