Zach Mueller leads Accelerate at Hugging Face and spends his days helping people go from solo scripts to scalable systems. In this episode, he joins me to demystify distributed training and inference — not just for research labs, but for any ML engineer trying to ship real software.

• From Colab to clusters: why scaling isn’t just about training massive models, but serving agents, handling load, and speeding up iteration

• Zero-to-two GPUs: how to get started without Kubernetes, Slurm, or a PhD in networking

• Scaling tradeoffs: when to care about interconnects, which infra bottlenecks actually matter, and how to avoid chasing performance ghosts

• The GPU middle class: strategies for training and serving on a shoestring, with just a few cards or modest credits

• Local experiments, global impact: why learning distributed systems—even just a little—can set you apart as an engineer