Vanishing Gradients

Episode 43: Tales from 400+ LLM Deployments: Building Reliable AI Agents in Production


Listen Later

Hugo speaks with Alex Strick van Linschoten, Machine Learning Engineer at ZenML and creator of a comprehensive LLMOps database documenting over 400 deployments. Alex's extensive research into real-world LLM implementations gives him unique insight into what actually works—and what doesn't—when deploying AI agents in production.

In this episode, we dive into:

  • The current state of AI agents in production, from successes to common failure modes
  • Practical lessons learned from analyzing hundreds of real-world LLM deployments
  • How companies like Anthropic, Klarna, and Dropbox are using patterns like ReAct, RAG, and microservices to build reliable systems
  • The evolution of LLM capabilities, from expanding context windows to multimodal applications
  • Why most companies still prefer structured workflows over fully autonomous agents
  • We also explore real-world case studies of production hurdles, including cascading failures, API misfires, and hallucination challenges. Alex shares concrete strategies for integrating LLMs into your pipelines while maintaining reliability and control.

    Whether you're scaling agents or building LLM-powered systems, this episode offers practical insights for navigating the complex landscape of LLMOps in 2025.

    LINKS

    • The podcast livestream on YouTube
    • The LLMOps database
    • All blog posts about the database
    • Anthropic's Building effective agents essay
    • Alex on LinkedIn
    • Hugo on twitter
    • Vanishing Gradients on twitter
    • Vanishing Gradients on YouTube
    • Vanishing Gradients on Twitter
    • Vanishing Gradients on Lu.ma
    • ...more
      View all episodesView all episodes
      Download on the App Store

      Vanishing GradientsBy Hugo Bowne-Anderson

      • 5
      • 5
      • 5
      • 5
      • 5

      5

      11 ratings


      More shows like Vanishing Gradients

      View all
      a16z Podcast by Andreessen Horowitz

      a16z Podcast

      1,032 Listeners

      Data Skeptic by Kyle Polich

      Data Skeptic

      480 Listeners

      The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

      The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

      441 Listeners

      Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

      Super Data Science: ML & AI Podcast with Jon Krohn

      298 Listeners

      NVIDIA AI Podcast by NVIDIA

      NVIDIA AI Podcast

      322 Listeners

      DataFramed by DataCamp

      DataFramed

      267 Listeners

      Practical AI by Practical AI LLC

      Practical AI

      192 Listeners

      Google DeepMind: The Podcast by Hannah Fry

      Google DeepMind: The Podcast

      198 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      88 Listeners

      Dwarkesh Podcast by Dwarkesh Patel

      Dwarkesh Podcast

      408 Listeners

      No Priors: Artificial Intelligence | Technology | Startups by Conviction

      No Priors: Artificial Intelligence | Technology | Startups

      121 Listeners

      Latent Space: The AI Engineer Podcast by swyx + Alessio

      Latent Space: The AI Engineer Podcast

      75 Listeners

      AI + a16z by a16z

      AI + a16z

      31 Listeners

      High Signal: Data Science | Career | AI by Delphina

      High Signal: Data Science | Career | AI

      4 Listeners

      OpenAI Podcast by OpenAI

      OpenAI Podcast

      28 Listeners