Practical AI

Testing ML systems


Listen Later

Production ML systems include more than just the model. In these complicated systems, how do you ensure quality over time, especially when you are constantly updating your infrastructure, data and models? Tania Allard joins us to discuss the ins and outs of testing ML systems. Among other things, she presents a simple formula that helps you score your progress towards a robust system and identify problem areas.

Join the discussion

Changelog++ members support our work, get closer to the metal, and make the ads disappear. Join today!

Featuring:

  • Tania Allard – Website, GitHub, X
  • Chris Benson – Website, GitHub, LinkedIn, X
  • Daniel Whitenack – Website, GitHub, X

Show Notes:

  • “What’s your ML score” talk
  • “Jupyter Notebooks: Friends or Foes?” talk
  • Joel Grus’s episode: “AI code that facilitates good science”
  • Papermill
  • nbdev
  • nbval
  • Books

    • “DevOps For Dummies” by Emily Freeman
    • Something missing or broken? PRs welcome!

      ...more
      View all episodesView all episodes
      Download on the App Store

      Practical AIBy Practical AI LLC

      • 4.4
      • 4.4
      • 4.4
      • 4.4
      • 4.4

      4.4

      185 ratings


      More shows like Practical AI

      View all
      The AI in Business Podcast by Daniel Faggella

      The AI in Business Podcast

      170 Listeners

      Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

      Super Data Science: ML & AI Podcast with Jon Krohn

      303 Listeners

      NVIDIA AI Podcast by NVIDIA

      NVIDIA AI Podcast

      334 Listeners

      Last Week in AI by Skynet Today

      Last Week in AI

      306 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      95 Listeners

      Me, Myself, and AI by MIT Sloan Management Review

      Me, Myself, and AI

      110 Listeners

      AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

      AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning

      154 Listeners

      This Day in AI Podcast by Michael Sharkey, Chris Sharkey

      This Day in AI Podcast

      227 Listeners

      The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

      The AI Daily Brief: Artificial Intelligence News and Analysis

      608 Listeners

      AI For Humans: Making Artificial Intelligence Fun & Practical by Kevin Pereira & Gavin Purcell

      AI For Humans: Making Artificial Intelligence Fun & Practical

      275 Listeners

      Everyday AI Podcast – An AI and ChatGPT Podcast by Everyday AI

      Everyday AI Podcast – An AI and ChatGPT Podcast

      107 Listeners

      A Beginner's Guide to AI by Dietmar Fischer

      A Beginner's Guide to AI

      54 Listeners

      AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI by Jaeden Schafer and Jamie McCauley

      AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI

      173 Listeners

      AI + a16z by a16z

      AI + a16z

      35 Listeners

      The TED AI Show by TED

      The TED AI Show

      49 Listeners