
Sign up to save your podcasts
Or


Why it matters. Someone finally ran a proper pentest on autonomous AI agents — not a benchmark, not a toy environment, but a live deployment with persistent memory, email, Discord, file systems, and shell execution. Agents of Chaos documents eleven distinct failure modes discovered over two weeks of red-teaming by twenty AI researchers, and every single one maps to a known vulnerability class in traditional security engineering. The episode then pivots to EMPO², a hybrid reinforcement learning framework from Microsoft Research that starts to address the deeper problem: training agents that explore alternatives and learn from failures instead of defaulting to catastrophic compliance.
Northeastern University, Carnegie Mellon University, Microsoft Research, KAIST. The Agents of Chaos study is a multi-institutional effort led out of Northeastern's Bau Lab with collaborators across CMU, UBC, UT Austin, and several other institutions. The paper is available on arXiv (2602.20021), with a project page at agentsofchaos.baulab.info. EMPO² comes from Microsoft Research Asia and KAIST, available on arXiv (2602.23008) with code on GitHub and a project page at agent-lightning.github.io.
The Researchers. Agents of Chaos is led by Natalie Shapira (Northeastern, interpretability and Theory of Mind) and David Bau (Northeastern, interpretable deep networks, ex-Google, Sloan fellow), with significant contributions from Chris Wendler, Avery Yen, Gabriele Sarti, Koyena Pal, Christoph Riedl (Northeastern, computational social science), Maarten Sap (CMU, social AI), Tomer Ullman (Harvard, cognitive science), and David Manheim — thirty-eight authors in total. EMPO² is the work of Zeyuan Liu, Jeonghye Kim, Xufang Luo (MSRA), Dongsheng Li (MSRA Shanghai, principal research manager), and Yuqing Yang.
Key Technical Concepts. The eleven failure modes documented in Agents of Chaos map directly to established vulnerability taxonomies: unauthorized compliance is CWE-285 (improper authorization), prompt injection with lateral movement echoes OWASP LLM01, and the circular agent-to-agent relay that ran for nine days consuming 60,000+ tokens is classic resource exhaustion (CWE-400). The fundamental structural cause is token indistinguishability — agents cannot separate instructions from data, a problem formalized in prior work on indirect prompt injection. EMPO² addresses the remediation layer through a dual-update paradigm combining parametric learning (weight updates via RL, extending GRPO) with non-parametric learning (external memory of self-generated "tips" from trajectory reflection), plus intrinsic rewards based on state novelty to encourage exploration in RL. The framework achieved 128.6% improvement over GRPO on ScienceWorld and demonstrated out-of-distribution adaptation within ten trials using memory alone — no weight updates required.
Daily Tech Feed: From the Labs is available on Apple Podcasts, Spotify, and wherever fine podcasts are distributed. Visit us at pod.c457.org for all our shows. New episodes daily.
Why it matters. The most important robotics breakthrough of the last three years wasn't a new algorithm or a bigger model — it was making the hardware cheap enough to collect enough data. This episode traces the ALOHA lineage from a $20,000 bimanual teleoperation rig in a Stanford garage to Google DeepMind's Gemini Robotics foundation model, across six papers and three years of compounding insight. The thesis is counterintuitive and instructive: cost reduction unlocked data scale, data scale unlocked generalization, and generalization unlocked everything else.
Stanford University / Google DeepMind. The ALOHA line begins at Stanford and migrates into Google DeepMind. Papers covered: ALOHA (RSS 2023), Mobile ALOHA (2024), ALOHA 2 (2024), ALOHA Unleashed (2024), Gemini Robotics (2025), and Gemini Robotics 1.5 (2025). Project pages: ALOHA, Mobile ALOHA, ALOHA Unleashed.
The Researchers. Tony Z. Zhao (Stanford → co-founder/CEO of Sunday Robotics), Zipeng Fu (Stanford), Chelsea Finn (Stanford, associate professor), Sergey Levine (UC Berkeley), Vikash Kumar (Meta → University of Washington), Jonathan Tompson, Danny Driess, Pete Florence, Kamyar Ghasemipour, and Ayzaan Wahid (Google DeepMind).
Key Technical Concepts. The original ALOHA paper introduced low-cost bimanual teleoperation using ViperX 300 arms (~$20K total) with Action Chunking with Transformers (ACT), which predicts sequences of future actions rather than single timesteps — critical for smooth, temporally coherent manipulation. Mobile ALOHA added a mobile base and demonstrated co-training: mixing a small task-specific dataset with a large heterogeneous dataset to improve generalization. ALOHA Unleashed replaced ACT with a diffusion policy for multi-modal action distributions, enabling the chopstick cube transfer and other contact-rich tasks. The progression culminates in Gemini Robotics, a vision-language-action (VLA) model that integrates language understanding with physical manipulation, and Gemini Robotics 1.5, which adds embodied reasoning, thinking, and cross-embodiment motion transfer. The throughline: imitation learning at scale beats engineering at cost.
Daily Tech Feed: From the Labs is available on Apple Podcasts, Spotify, and wherever fine podcasts are distributed. Visit us at pod.c457.org for all our shows. New episodes daily.
Now let me research the key people and links to ensure accuracy.
I have enough to write the show notes. Let me check prior episode format for consistency.
That's HTML format. Let me check if there's a markdown version pattern or if HTML is standard.
The system prompt says "rich markdown show notes." Let me produce markdown per the format spec.
Now I have enough. Let me also look up the Semaphore protocol and Least Authority audit for links.
Here are the show notes:
Why it matters. As AI-generated content becomes indistinguishable from human output, every behavioral authentication system is failing — CAPTCHAs, voice verification, video identity checks. This episode dissects World ID's proof-of-personhood protocol, walking through the cryptographic architecture described in Large-Scale MPC: Scaling Private Iris Code Uniqueness Checks to Millions of Users and explaining why the system that Reddit loves to hate is, mathematically, the most sophisticated attempt at solving the Sybil problem at global scale. From Daugman iris codes to Shamir Secret Sharing to Anonymous Multi-Party Computation to zero-knowledge proofs — and a frank accounting of the company's exploitative rollout in Kenya and the developing world.
World Foundation / TACEO / Tools for Humanity. The core SMPC paper is hosted at IACR ePrint 2024/705 (PDF). The World ID protocol is open source on GitHub, including the iris recognition system, Orb software, and protocol documentation. TACEO, the Austrian cryptographic infrastructure company that co-authored the paper, is at taceo.io. The SMPC implementation was audited by Least Authority. Vitalik Buterin's foundational analysis is What do I think about biometric proof of personhood? (July 2023).
The Researchers. Remco Bloemen (head of protocol, World Foundation), Daniel Kales (co-founder, TACEO; PhD in post-quantum cryptography, Graz University of Technology), Bryan Gillespie (World Foundation), Philipp Sippl and Roman Walch (TACEO). The episode also covers the foundational work of John Daugman (Cambridge, inventor of iris recognition) and Adi Shamir (Weizmann Institute, co-inventor of RSA, creator of Shamir's Secret Sharing).
Key Technical Concepts. The episode covers iris codes — 12,800-bit binary representations generated via Gabor wavelets, compared using Hamming distance. The privacy architecture progressed from centralized storage (2023) to Secure Multi-Party Computation (2024, using Shamir's Secret Sharing with information-theoretic security) to Anonymous MPC (2025), where even the shares are anonymized and computation runs on independent nodes at UC Berkeley, University of Erlangen-Nuremberg, KAIST, UTEC, and Nethermind. Usage privacy relies on zero-knowledge proofs via ZK-SNARKs built on the Semaphore protocol, enabling unlinkable proof-of-humanity across services. The episode also references Sybil attacks, Buterin's analysis of proof of personhood, and MIT Technology Review's investigation of the Kenya rollout.
Daily Tech Feed: From the Labs is available on Apple Podcasts, Spotify, and wherever fine podcasts are distributed. Visit us at pod.c457.org for all our shows. New episodes daily.
A single-paper deep dive into "H-Neurons" by Cheng Gao and colleagues at Tsinghua University. The paper identifies a remarkably sparse subset of neurons — less than 0.1% of total neurons in a large language model — whose activation patterns reliably predict when the model is about to hallucinate. These "H-Neurons" generalize across domains, tasks, and even to questions about completely fabricated entities. Most provocatively, the paper finds these neurons are causally linked to over-compliance behaviors: amplifying them makes models more sycophantic, more susceptible to misleading context, and more willing to follow harmful instructions. The uncomfortable implication: alignment training itself may be what makes models lie.
H-Neurons: On the Existence, Impact, and Origin of Hallucination-Associated Neurons in LLMs — Cheng Gao et al., Tsinghua University. December 2025. 20 pages, 4 figures.
PDF · HTML version
The episode explores the tension between the paper's findings and the broader question of what "hallucination" actually is. Reddit commenters raised pointed objections: (1) hallucination is not a single failure mode — it encompasses confabulated citations, logical errors, and confident nonsense, and it's unclear they all share a mechanism; (2) modern training incentivizes hallucination — models that guess confidently score higher than models that say "I don't know"; (3) these neurons may be detecting uncertainty rather than causing hallucination. The paper's finding that H-Neurons emerge during pre-training (not alignment) complicates the narrative, suggesting the capacity for over-compliance is baked in from the start.
Daily Tech Feed: From the Labs is available on Apple Podcasts, Spotify, and wherever fine podcasts are distributed. Visit us at pod.c457.org for all our shows. New episodes daily.
This episode was researched and written with AI assistance. Technical claims have been verified against the primary paper.
Why it matters. The FDA has cleared the first-ever human trial of a therapy designed to partially reverse cellular aging. Life Biosciences' ER-100, an epigenetic reprogramming treatment targeting serious vision loss, marks the leap from decades of mouse studies to an actual Phase 1 human trial. The episode dissects the science, the hype, and the complicated legacy of the man behind it — asking whether partial cellular reprogramming is the breakthrough longevity researchers have promised or another cycle of premature optimism in a field prone to it.
Life Biosciences / Harvard Medical School. The trial is registered on ClinicalTrials.gov (NCT07290244). The foundational research was published in Nature (2020) demonstrating recovery of youthful epigenetic information and restored vision in mice. Coverage from Fortune, MIT Technology Review, Lifespan.io, and Longevity.technology. A summary of Sinclair's World Government Summit 2026 talk provides additional context on the "Information Theory of Aging." The Wall Street Journal investigation (2024) into Sinclair's business track record offers critical counterweight. The demographic claim about cancer and lifespan traces to a 1990 LA Times report.
The Researchers. David Sinclair is a professor of genetics at Harvard Medical School and co-director of the Paul F. Glenn Center for Biology of Aging Research, best known for his work on sirtuins, NAD+, and resveratrol. The foundational Yamanaka factor work was done by Shinya Yamanaka, who won the 2012 Nobel Prize in Physiology or Medicine for discovering that mature cells can be reprogrammed to pluripotent stem cells. The 2020 Nature paper's lead authors include Yuancheng Lu and Bruce Bhatt, with senior authorship from Sinclair.
Key Technical Concepts. The trial centers on partial epigenetic reprogramming — using a subset of Yamanaka factors (OCT4, SOX2, KLF4, delivered via AAV vector) to rejuvenate cells without fully dedifferentiating them. The underlying hypothesis is Sinclair's Information Theory of Aging, which posits that aging is driven by epigenetic noise — the progressive loss of gene-regulatory information — rather than genomic mutations. The 2020 mouse study demonstrated that this approach could restore DNA methylation patterns to a younger state and recover lost vision in aged mice and glaucoma models. The critical open question is whether partial reprogramming in humans can achieve rejuvenation without triggering teratoma formation, the cancer risk inherent in full cellular reprogramming.
Daily Tech Feed: From the Labs is available on Apple Podcasts, Spotify, and wherever fine podcasts are distributed. Visit us at pod.c457.org for all our shows. New episodes daily.
Why it matters. Microsoft Research published a complete system for writing data into ordinary borosilicate glass using femtosecond lasers in Nature. A palm-sized square holds nearly 5TB and survives for over 10,000 years. This episode traces the 30-year journey from Eric Mazur's 1996 breakthrough to Project Silica's open blueprint.
Microsoft Research — Project Silica. Nature paper · Project Silica blog post
AI-assisted production. See About for details.
Why it matters. Every deployed language model hits a memory wall: the key-value cache grows linearly with context length, and current solutions—summarization, token eviction, token merging—are catastrophically lossy at high compression ratios. Fast KV Compaction via Attention Matching proposes compressing context in latent space rather than token space, directly constructing compact keys and values that reproduce the original attention mechanism's behavior. Using closed-form linear algebra instead of gradient descent, Attention Matching achieves 50× compression in seconds with quality rivaling expensive end-to-end optimization methods—and dramatically outperforming summarization on information-dense tasks like medical records QA, where summarization performs no better than having no context at all.
MIT CSAIL. The paper comes from MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL). It builds on Cartridges (GitHub), which demonstrated latent-space KV cache compaction but required GPU-hours of gradient-based optimization per context. The Attention Matching code is available on GitHub. The paper is on arXiv (HTML version). Related prior work on token eviction includes H2O, SnapKV, PyramidKV, and KVzip.
The Researchers. Adam Zweiger (MIT undergraduate, lead author, personal site), Xinghong Fu (MIT), Han Guo (MIT PhD student, personal site), and Yoon Kim (Associate Professor at MIT CSAIL, faculty page).
Key Technical Concepts. The core innovation is Attention Matching: instead of optimizing a language model's final output end-to-end (as Cartridges does via prefix-tuning), the method optimizes attention outputs and attention mass directly at each KV head. This decomposes into three sequential steps—key selection (via attention scoring or orthogonal matching pursuit), bias fitting via nonnegative least squares, and value fitting via ordinary least squares—each with efficient closed-form or near-closed-form solutions. Scalar biases added to attention logits allow compact keys to account for multiple original tokens' worth of attention mass, leveraging the softmax decomposition used by FlashAttention. The paper's most impactful finding is nonuniform head budgets: attention head sensitivity to compaction is stable across inputs, so a one-time per-model budget allocation (computed via greedy exchange) dominates all other design choices. This connects to findings in hybrid architectures like Gemma 3, where most heads naturally specialize to local context and only a few perform long-range retrieval.
Daily Tech Feed: From the Labs is available on Apple Podcasts, Spotify, and wherever fine podcasts are distributed. Visit us at pod.c457.org for all our shows. New episodes daily.
Series: Greatest Hits — Ilya Sutskever's Reading List
The only full textbook on Ilya Sutskever's famous ~30 item reading list. Why did a deep learning pioneer tell John Carmack to study algorithmic randomness? Because compression is intelligence — and this book is the mathematical foundation for that claim.
We cover the key concepts: Kolmogorov complexity, the invariance theorem, incompressibility, algorithmic randomness, Berry's paradox, connections to Gödel and Turing, and why all of this matters for understanding why neural networks generalize.
This episode was researched and written with AI assistance.
A single-paper deep dive into DreamZero, a 14B World Action Model from NVIDIA that jointly predicts future video states and robot actions — enabling zero-shot generalization to unseen tasks, cross-embodiment transfer from 10–20 minutes of video, and real-time closed-loop control at 7Hz. This paper proposes a new paradigm: rather than grounding robot policies in language models, ground them in video generation. Physics lives in video. And video generation keeps getting better.
Why it matters. "World Action Models are Zero-shot Policies" introduces DreamZero, a World Action Model (WAM) built on a pretrained video diffusion backbone. Unlike Vision-Language-Action (VLA) models, which inherit semantic knowledge from image-text datasets but lack physical dynamics, WAMs learn spatiotemporal physics from video and jointly generate future frames and motor actions. DreamZero achieves over 2× improvement on generalization benchmarks versus state-of-the-art VLAs, 39.5% average task progress on completely unseen tasks (vs. near-zero for VLAs), 42% relative improvement from video-only cross-embodiment data, and new-embodiment adaptation with only 30 minutes of play data.
Project page: dreamzero0.github.io — includes a living gallery of 100+ zero-shot tasks the robot discovered through interactive prompting: fanning burgers, pressing elevator buttons, playing xylophone, shaking tambourine, watering plants, and more.
Open-source release: github.com/dreamzero0/dreamzero — model weights, inference code, and code to run three public benchmarks: DROID, PolaRiS, and Genie Sim 3.0 (100 simulation tasks).
arXiv: arXiv:2602.15922 — submitted February 17, 2026. HTML version also available.
DreamZero is a 14B autoregressive diffusion transformer (DiT) initialized from the WAN image-to-video model (Team Wan, 2025), one of the strongest open video generation systems. The backbone was pretrained on web-scale video data, encoding spatiotemporal physical dynamics that VLMs trained on static image-text pairs lack.
Joint prediction: Given language instruction, visual observation history, and proprioceptive state, DreamZero simultaneously generates future video frames and motor actions. This is mathematically equivalent to factoring the policy into autoregressive video prediction and an inverse dynamics model (IDM) — but training end-to-end achieves tighter video-action alignment than training them separately.
Autoregressive + KV caching: Video is predicted in chunks. Each chunk conditions on clean previous chunks via KV caching, enabling fast inference. In the closed-loop robot setting, ground-truth camera observations replace predicted frames in the KV cache after each action chunk executes — eliminating the compounding error problem that normally plagues autoregressive video generation.
The 38× speedup stack:
Training: Flow-matching objective with teacher forcing. Shared denoising timestep between video and action modalities for faster convergence. Trained on approximately 500 hours of real-world robot data (AgiBot G1 pretraining) — heterogeneous behavioral data rather than repeated task demonstrations.
VLAs (Vision-Language-Action models): Built on top of VLMs (e.g., RT-2, pi0, GR00T-N1, Gemini Robotics). Inherit semantic knowledge but are pretrained on static image-text data. Excel at object and semantic generalization. Fail at novel physical motions because they lack spatiotemporal physical dynamics priors.
WAMs (World Action Models): Built on video diffusion backbones. Inherit spatiotemporal physical dynamics from web-scale video pretraining. Learn from every consecutive frame pair in training data, not just episode-level demonstrations. The key insight: video is a dense representation of how the physical world evolves — it encodes geometry, dynamics, and motor control in a way static images cannot.
Why "World Action Models" not "Video Action Models": The paper coins WAM deliberately — video is one possible world modeling objective, but future WAMs may align actions with tactile sensing, force feedback, or learned latent representations. The name reflects the broader paradigm, not just the current implementation.
Prior WAMs this paper builds on and distinguishes from:
DreamZero distinguishes itself by: (1) systematic exploration of data diversity over repeated demonstrations, (2) autoregressive architecture for long-horizon modeling and KV cache efficiency, (3) state-of-the-art generalization across both novel tasks and environments, and (4) state-of-the-art cross-embodiment transfer including few-shot embodiment adaptation.
Baselines compared: GR00T-N1 (NVIDIA's prior robotics model), pi0 (Physical Intelligence), OpenVLA, and DreamZero trained from scratch (without the video pretraining backbone) as an ablation.
Training data: DROID dataset (Stanford/Berkeley open-source robotics dataset, one of the most heterogeneous available) for the public reproduction experiments. Proprietary AgiBot G1 data for the main pretraining results.
The thesis of DreamZero can be stated simply: policy performance is fundamentally tied to video generation quality. If this holds, then the path to better robot policies is the same path as the path to better video generation — and hundreds of billions of dollars are flowing into video generation for entertainment, synthetic data, and film production. Every advance in video AI potentially advances robot AI.
This is a fundamentally different answer than "collect more robot demonstrations" or "scale up the VLM backbone." It connects the robotics scaling curve to the video generation scaling curve, and the video scaling curve is extremely steep right now.
The open-source release of DreamZero weights and benchmarks makes this accessible to the broader research community — not just labs with massive teleoperation infrastructure.
Daily Tech Feed: From the Labs is available on Apple Podcasts, Spotify, and wherever fine podcasts are distributed. Visit us at pod.c457.org for all our shows. New episodes daily.
This episode was researched and written with AI assistance. Technical claims have been verified against the primary paper.
A special edition covering three Google DeepMind outputs in four days: an autonomous mathematics research system, a theoretical framework connecting simplicity to optimization, and a commercial music generation model. Together, they illustrate the extraordinary range of a single lab operating across pure mathematics, algorithmic information theory, and creative AI.
Why it matters. "Towards Autonomous Mathematics Research" introduces Aletheia, a system built on Gemini Deep Think that doesn't just solve math problems — it conducts mathematical research. Aletheia achieves 95.1% on IMO-ProofBench Advanced (up from 65.7% in July 2025), autonomously solved four open problems from Erdős's collection of 700 unsolved conjectures, and generated a complete research paper (Feng2026) on eigenweights in arithmetic geometry with no human intervention.
Google DeepMind and collaborators. The paper is on arXiv (2602.10177) with an HTML version. The author list spans Google DeepMind, Caltech, UC Berkeley, Brown University, and other institutions. The system uses Gemini Deep Think with an agentic framework that can query mathematical databases, run computations in Lean and SageMath, and evaluate whether its own results are interesting.
Key Researchers. Demis Hassabis (CEO of Google DeepMind, Nobel Laureate for AlphaFold), Quoc V. Le (co-creator of sequence-to-sequence learning), Thang Luong (attention mechanisms pioneer), and Sergei Gukov (Caltech mathematician known for the Gukov-Vafa-Witten superpotential and work connecting topology to quantum field theory). The paper proposes a taxonomy of "Autonomous Mathematics Research Levels" modeled on SAE levels for self-driving cars, claiming Aletheia operates at Level 3–4.
Why it matters. Published in the journal Entropy, this paper by Kamal Dingle and Marcus Hutter makes three theoretical claims: optimal solutions to combinatorial problems tend to have low Kolmogorov complexity; sampling by algorithmic probability may be an effective optimization strategy; and coincidences in extremal values across objectives are more likely than chance because simple solutions cluster together. The implication: Pareto-optimal solutions across multiple objectives may be more findable than worst-case analysis predicts.
The Researchers. Marcus Hutter is the creator of AIXI, the theoretical framework for universal artificial intelligence, and a Senior Researcher at Google DeepMind / Professor at Australian National University. He is arguably the world's foremost expert on the computational implications of Kolmogorov complexity. Kamal Dingle is an Associate Professor at Gulf University for Science and Technology working on algorithmic information theory and simplicity bias. Their prior work includes foundational results on simplicity bias in input-output maps.
Why it matters. On February 18, 2026, DeepMind released Lyria 3 — a music generation model integrated into the Gemini app that generates 30-second tracks with vocals in eight languages (English, Spanish, French, German, Italian, Portuguese, Japanese, Korean) from text, image, or video prompts. No research paper was published — this is a product launch, signaling that DeepMind views music AI as a product line, not a research curiosity.
The competitive landscape. Lyria 3 joins an increasingly crowded field. Suno and Udio lead the commercial space, while open-source has arrived with HeartMuLa — a family of Apache 2.0 licensed music foundation models (3B parameters) that already match or exceed closed-source offerings on musicality and controllability. HeartMuLa generates full-length songs rather than 30-second clips, and its unreleased 7B model reportedly matches Suno. Lyria 3's moat is distribution (embedded in Google's ecosystem), not technology. Google embeds SynthID watermarks in all generated audio for provenance tracking.
Daily Tech Feed: From the Labs is available on Apple Podcasts, Spotify, and wherever fine podcasts are distributed. Visit us at pod.c457.org for all our shows. New episodes daily.
From the publisher's feed