In this episode of Hidden Layers: Decoded, Ron Green, Dr. ZZ Si, and Michael Wharton explore the latest AI breakthroughs, including DeepSeek’s R1 model, Meta’s work on intuitive physics, and Stanford’s S1 model. They discuss the rise of cost-effective reinforcement learning, diffusion-based language models, and DeepMind’s advances in geometry-solving AI. The team also dives into AI-driven biology with Evo2 and the emergence of civilizations in a Minecraft simulation. Throughout, they reflect on the future of AI, from domain-specific models to the impact of world models on business and science.
00:00:00 - Introduction & Podcast Overview
00:03:40 - DeepSeek R1: Emergent Reasoning & Training Methodology
00:12:23 - Intuitive Physics & Video Understanding in AI
00:19:38 - Cost-Effective RL: The S1 Model & Budget Forcing Technique
00:26:34 - Diffusion-Based Language Models & Iterative Refinement
00:33:03 - AI Agents in Minecraft: Project CID & Emergent Civilization
00:38:39 - Evo2: A 40B-Parameter Breakthrough in Biological Modeling
00:40:36 - DeepMind’s Alpha Geometry 2: From Silver to Gold
00:42:02 - Distilling Scaling Laws: Insights on Compute-Optimal Distillation
00:48:47 - Reinforcement Learning & Future AI Strategies