Production ML systems include more than just the model. In these complicated systems, how do you ensure quality over time, especially when you are constantly updating your infrastructure, data and models? Tania Allard joins us to discuss the ins and outs of testing ML systems. Among other things, she presents a simple formula that helps you score your progress towards a robust system and identify problem areas.

Testing ML systems

Making artificial intelligence practical, productive &amp; accessible to everyone.  Practical AI is a show in which technology professionals, business people, students, enthusiasts, and expert guests engage in lively discussions about Artificial Intelligence and related topics (Machine Learning, Deep Learning, Neural Networks, GANs, MLOps, AIOps, LLMs &amp; more). The focus is on productive implementations and real-world scenarios that are accessible to everyone. If you want to keep up with the latest advances in AI, while keeping one foot in the real world, then this is the show for you!

Technology

Tech News

Podcasting

Gadgets

Software How-To

2024 promises to be the year of multi-modal AI, and we are already seeing some amazing things. In this “fully connected” episode, Chris and Daniel explore the new Udio product/service for generating music. Then they dig into the differences between recent multi-modal efforts and more “traditional” ways of combining data modalities.

Udio & the age of multi-modal AI

Daniel & Chris delight in conversation with “the funniest guy in AI”, Demetrios Brinkmann.  Together they explore the results of the MLOps Community’s latest survey. They also preview the upcoming AI Quality Conference.

RAG continues to rise

In this fully connected episode, Daniel & Chris discuss NVIDIA GTC keynote comments from CEO Jensen Huang about teaching kids to code.  Then they dive into the notion of “community” in the AI world, before discussing challenges in the adoption of generative AI by non-technical people.  They finish by addressing the evolving balance between generative AI interfaces and search engines.

Should kids still learn to code?

Daniel and Chris are out this week, so we’re bringing you conversations all about AI’s complicated relationship to software developers from other Changelog pods: JS Party, Go Time & The Changelog.

AI vs software devs

Daniel & Chris explore the state of the art in prompt engineering with Jared Zoneraich, the founder of PromptLayer. PromptLayer is the first platform built specifically for prompt engineering.  It can visually manage prompts, evaluate models, log LLM requests, search usage history, and help your organization collaborate as a team.  Jared provides expert guidance in how to be implement prompt engineering, but also illustrates how we got here, and where we’re likely to go next.

Testing ML systems

Download our free app to listen on your phone