
Sign up to save your podcasts
Or


Send us Fan Mail
Every day, thousands of people lie down, count backward from ten, and vanish for hours. We’ve done this for 180 years without knowing how it works. 🧠
A new study in Nature Neuroscience compared humans, macaques, marmosets, mice, zebrafish and a 302-neuron worm. Across 700 million years of evolution, they found 485 shared mathematical signatures of unconsciousness.
✨ The “echo” of a thought collapses.
✨ Brain regions lose their rhythm.
✨ Five volts to one thalamic hub woke anesthetized monkeys.
It isn’t darkness. It’s fragmentation, and understanding it may one day make waking up gentler. 💛
📖 Read: https://helioxpodcast.substack.com
🎥 YouTube: https://www.youtube.com/channel/UCd5BbCEeC3Z6dp-nNjWRbBw
🎙️Available for Broadcast: https://exchange.prx.org/group_accounts/253118-heliox_where_evidence_meets_empathy
This is Heliox: Where Evidence Meets Empathy
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Support the show
Disclosure: This podcast uses AI-generated synthetic voices for a material portion of the audio content, in line with Apple Podcasts guidelines.
We make rigorous science accessible, accurate, and unforgettable.
Produced by Michelle Bruecker and Scott Bleackley, it features reviews of emerging research and ideas from leading thinkers, curated under our creative direction with AI assistance for voice, imagery, and composition. Systemic voices and illustrative images of people are representative tools, not depictions of specific individuals.
We dive deep into peer-reviewed research, pre-prints, and major scientific works—then bring them to life through the stories of the researchers themselves. Complex ideas become clear. Obscure discoveries become conversation starters. And you walk away understanding not just what scientists discovered, but why it matters and how they got there.
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Spoken word, short and sweet, with rhythm and a catchy beat.
http://tinyurl.com/stonefolksongs
Send us Fan Mail
📖 Read
How Dream-RSI turns a machine's failures into a simulated universe and cuts the cost of self-improvement up to 162-fold
What if every dead end you ever hit was secretly a map? In this deep dive, we unpack Dream-RSI, a new science podcast-worthy paper from researchers at the University of Maryland, Google DeepMind, and the University of Virginia. It shows how an AI agent can log its failed attempts, convert them into a replay simulator, and "dream" better exploration strategies offline. In reported tests, that meant up to 162 times fewer agent calls than a baseline requiring 51,200 generations.
We trace the idea from Kenneth Craik's 1943 mental models through Turing, Rodney Brooks, Richard Sutton, and Jürgen Schmidhuber to today's embodied world models. We also contrast vision-language-action models with world models, work through the hard questions about off-policy risk, and see the results on Lasso solvers, circle packing, and GPU kernel engineering. Then we ask what your own discarded logs could become.
A thoughtful, evidence-based, research-backed conversation for anyone curious about AI research, machine learning, recursive self-improvement, and critical thinking. Podcast 2026: new episode. Related essays, polls, and study materials are at helioxpodcast.substack.com.
References
Dream-RSI: Recursive Self-Improvement through Evolving Worlds
and 19 other references
Chapters
00:00 Welcome to Heliox: Learning the Hard Way
01:01 The Wobbly Chair: Simulating Before Acting
02:11 AI Hits the Compute Wall
04:29 The Big Idea: A World Model Built From Mistakes
05:04 Craik, Turing, and the Birth of Mental Models
08:01 GOFAI, Brooks, and the Reactive Rebellion
10:07 Dyna and Schmidhuber: Splitting Controller From World Model
13:06 Ha and Schmidhuber: Dreaming in Latent Space
14:09 VLA Models and Their Three Fatal Flaws
17:40 Embodied World Models and Intuitive Physics
19:44 Recursive Self-Improvement Explained
21:11 The Meta-Optimization Bottleneck
23:33 SimpleTES and 51,200 Generations
24:30 Dream RSI: A Simulator Built From History
25:24 Stage One: The Online Explorer
26:13 Stage Two: Trash Becomes a Replay Simulator
27:06 Stage Three: Dreaming Better Strategies
28:23 The Skeptic's Challenge: Off-Policy Risk
30:51 Closing the Self-Improving Loop
31:41 Eight Tasks, Three Domains
32:27 Lasso Solvers: 162 Times Fewer Calls
34:26 Circle Packing: Escaping Local Minima
36:06 GPU Kernels: Mapping the Jagged Cliff
38:44 Full Circle: Thinking in a Dream Is Nearly Free
40:57 Your Failures as Structural Capital
42:37 Credits, Pillars, and Sign-Off
This is Heliox: Where Evidence Meets Empathy
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Support the show
Disclosure: This podcast uses AI-generated synthetic voices for a material portion of the audio content, in line with Apple Podcasts guidelines.
We make rigorous science accessible, accurate, and unforgettable.
Produced by Michelle Bruecker and Scott Bleackley, it features reviews of emerging research and ideas from leading thinkers, curated under our creative direction with AI assistance for voice, imagery, and composition. Systemic voices and illustrative images of people are representative tools, not depictions of specific individuals.
We dive deep into peer-reviewed research, pre-prints, and major scientific works—then bring them to life through the stories of the researchers themselves. Complex ideas become clear. Obscure discoveries become conversation starters. And you walk away understanding not just what scientists discovered, but why it matters and how they got there.
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Spoken word, short and sweet, with rhythm and a catchy beat.
http://tinyurl.com/stonefolksongs
Send us Fan Mail
Imagine discovering an animal that goes limp, shuts off its senses, and hallucinates for a third of its life. A design flaw, right? Not so fast. 🌙
A 2026 hypothesis suggests sleep is a loop: deep non-REM sleep repairs and flushes the brain, then REM sleep runs a dream-powered stress test to check the work, over and over, all night.
✨ Why your brain's "fluid flush" may matter for long-term brain health
✨ Why REM is a virtual-reality diagnostic with your muscles safely switched off
✨ Why ten hours at a desk leaves your legs feeling like lead
✨ Why caffeine mutes the alarm without doing the maintenance
✨ Why a nightmare might actually be a stress test passed
It's a new hypothesis, and we're upfront about where it's still debated. Listen, read, and share with someone who could use a better night. 💙
References
Why Do We Sleep? Why Do We Dream? An Integrative Hypothesis Based on Current Neuroscience and Clinical Observations
📖 Read: https://helioxpodcast.substack.com
🎥 YouTube: https://www.youtube.com/channel/UCd5BbCEeC3Z6dp-nNjWRbBw
🎙️Available for Broadcast: https://exchange.prx.org/group_accounts/253118-heliox_where_evidence_meets_empathy
This is Heliox: Where Evidence Meets Empathy
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Support the show
Disclosure: This podcast uses AI-generated synthetic voices for a material portion of the audio content, in line with Apple Podcasts guidelines.
We make rigorous science accessible, accurate, and unforgettable.
Produced by Michelle Bruecker and Scott Bleackley, it features reviews of emerging research and ideas from leading thinkers, curated under our creative direction with AI assistance for voice, imagery, and composition. Systemic voices and illustrative images of people are representative tools, not depictions of specific individuals.
We dive deep into peer-reviewed research, pre-prints, and major scientific works—then bring them to life through the stories of the researchers themselves. Complex ideas become clear. Obscure discoveries become conversation starters. And you walk away understanding not just what scientists discovered, but why it matters and how they got there.
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Spoken word, short and sweet, with rhythm and a catchy beat.
http://tinyurl.com/stonefolksongs
Send us Fan Mail
You step onto a staircase in a city you've never visited. Your neck prickles. You KNOW there's a Picasso hanging on the left at the top. 🖼️
You've never been here. So why is your brain so sure?
In this episode we put two sources side by side: Cleveland Clinic neurology and Colorado State University cognitive psychology.
Here's what they show:
🧠 Déjà vu is a brief misfire between two memory systems. Familiarity says "I know this!" while recollection can't find the file.
✈️ It's more common in people who travel, study and remember their dreams. It's a sign of a well-stocked mind.
😴 Fatigue, jet lag and stress make it more likely, and persistent déjà vu with confusion or a pounding headache deserves a neurologist.
🎮 Researchers even built déjà vu in a video-game maze, froze it just before the final turn and asked people which way it went. About half felt strong premonition. Their accuracy? A coin flip.
📖 Read: https://helioxpodcast.substack.com
🎥 YouTube: https://www.youtube.com/channel/UCd5BbCEeC3Z6dp-nNjWRbBw
🎙️Available for Broadcast: https://exchange.prx.org/group_accounts/253118-heliox_where_evidence_meets_empathy
References
Crawling under the radar: Two novel Paulinella species expand knowledge about the ecology and evolution of a primary plastid-containing amoeba lineage
This is Heliox: Where Evidence Meets Empathy
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Support the show
Disclosure: This podcast uses AI-generated synthetic voices for a material portion of the audio content, in line with Apple Podcasts guidelines.
We make rigorous science accessible, accurate, and unforgettable.
Produced by Michelle Bruecker and Scott Bleackley, it features reviews of emerging research and ideas from leading thinkers, curated under our creative direction with AI assistance for voice, imagery, and composition. Systemic voices and illustrative images of people are representative tools, not depictions of specific individuals.
We dive deep into peer-reviewed research, pre-prints, and major scientific works—then bring them to life through the stories of the researchers themselves. Complex ideas become clear. Obscure discoveries become conversation starters. And you walk away understanding not just what scientists discovered, but why it matters and how they got there.
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Spoken word, short and sweet, with rhythm and a catchy beat.
http://tinyurl.com/stonefolksongs
Send us Fan Mail
📖 Read
Season 7 Review:
How Falling Walls Between Science, Bodies, and AI Are Changing Everything
What happens when the walls between medicine, climate science, neuroscience, and artificial intelligence collapse? In this Season 7 review, the Heliox deep-dive podcast looks back across 75 research-backed episodes to find a hidden pattern: the best answers live in the overlap between disciplines.
You'll hear how a Bayesian model revealed that two identical heart attacks can have completely different biological causes. You'll learn why a coffee-cup-sized bird is losing its migration meal, how sewers became early-warning systems for viruses, and why an open window can change how your body feels about temperature. We also explore long COVID microclots, the myth of the average brain, AI that learns from geometry, and a serviceberry-inspired vision of economics built on abundance rather than scarcity.
Four recurring narratives tie the season together: boundary dissolution, adaptive complexity, embodied knowledge, and quantum-like uncertainty.
In this episode:
00:25 The filing cabinet on fire
04:14 Two heart attacks, two engines
14:11 Complicated versus complex systems
23:24 Embodied knowledge
34:21 Quantum-like uncertainty
44:32 The serviceberry economy
Listen for thoughtful, science-based conversations on interdisciplinary research, critical thinking, and the future of AI. Find essays, polls, and study materials at helioxpodcast.substack.com. Like, subscribe, and leave a five-star review to help others find the show.
Reference
Heliox Season 7 Episodes
Chapters
00:00 Intro: Where Evidence Meets Empathy
00:25 The Filing Cabinet on Fire
01:25 Season 7: A Forest of 75 Deep Dives
02:00 Thank You to Listeners and Stations
02:47 Why Science Became Siloed
04:14 Aladynoulli: Two Heart Attacks, Two Engines
07:26 Who Owns an Idea? The Innovation Economy
10:07 Can AI Turn the Bureaucracy Ratchet Backward?
11:02 Swanson, Fish Oil, and AI Co-Scientists
12:56 GNoME and the Robot Lab
14:11 Adaptive Complexity: Rainforest vs Jet Engine
15:19 Clean Air, Heat Waves, and Systemic Memory
17:09 The Red Knot's Broken Clock
18:27 Climate's Procrastination Scenario
20:38 Sewage Viromes and Predicting Omicron
23:24 Embodied Knowledge: Beyond Descartes
24:07 Warm Hearts, Aymara Time, Hmong Life Strings
26:09 The Blue Spot: Chronic Pain Is Real
27:47 The Open Window Effect
29:10 Long COVID Microclots
31:06 Dogs, Empathy, and Trauma
34:21 Quantum-Like Uncertainty
36:54 The Myth of the Average Brain
38:16 Déjà Vu Explained
39:21 AI Escapes Flatland
41:12 Big AI on a Small Laptop
43:27 Cognitive Industrialization Warning
44:32 The Serviceberry Economy
46:52 What It Means for You
47:56 Help Us Grow the Conversation
48:48 Who Owns the Mind That Sand Built?
49:46 Credits and Closing
This is Heliox: Where Evidence Meets Empathy
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Support the show
Disclosure: This podcast uses AI-generated synthetic voices for a material portion of the audio content, in line with Apple Podcasts guidelines.
We make rigorous science accessible, accurate, and unforgettable.
Produced by Michelle Bruecker and Scott Bleackley, it features reviews of emerging research and ideas from leading thinkers, curated under our creative direction with AI assistance for voice, imagery, and composition. Systemic voices and illustrative images of people are representative tools, not depictions of specific individuals.
We dive deep into peer-reviewed research, pre-prints, and major scientific works—then bring them to life through the stories of the researchers themselves. Complex ideas become clear. Obscure discoveries become conversation starters. And you walk away understanding not just what scientists discovered, but why it matters and how they got there.
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Spoken word, short and sweet, with rhythm and a catchy beat.
http://tinyurl.com/stonefolksongs
Send us Fan Mail
📖 Read
How AI Is Learning to Act, Remember, Evolve, and Collaborate
What if the smartest mind on Earth were locked in a concrete room, brilliant at calculus but unable to fetch groceries? That's the problem behind today's AI, and this episode of Heliox explores the research roadmap for opening the door.
This is a science podcast deep dive into agentic reasoning, the shift from AI that only talks to AI that plans, uses tools, remembers, evolves, and collaborates. Drawing on a major survey from researchers at the University of Illinois Urbana-Champaign, Meta, Amazon, Google DeepMind, UC San Diego, and Yale, we unpack:
••The open problems: credit assignment over long horizons, and governance and safety for AI that acts
Reference
Agentic Reasoning for Large Language Model
Chapters
00:00 Welcome to Heliox: The Genius in the Concrete Room
01:35 When Bigger Models Hit a Wall
02:48 The Supergroup Behind the Roadmap
04:38 Passive One-Shot Inference Explained
06:30 POMDPs: Why Reality Isn't Chess
09:30 Factorized Policies: Thought vs. Action
11:17 In-Context vs. Post-Training Reasoning
14:07 GRPO: Grading Reasoning on a Curve
15:12 Agentic Search vs. Traditional RAG
17:30 Vibe Coding and OpenHands
19:35 The Amnesiac Agent Problem
21:21 Retry vs. Reflective Feedback
23:12 Flat vs. Structured Memory
24:41 Procedural Evolution: Voyager's Skill Library
26:32 Structural Evolution and AlphaEvolve
28:45 Why One Genius Isn't Enough
29:27 Multi-Agent Reasoning: Talking as Thinking
31:13 Managers, Workers, Critics, Memory Keepers
32:19 From Scripted Roles to Team Evolution
33:25 Theory of Mind in AI
36:32 Critic Agents: Peer Review for Robots
38:02 Real-World Deployment: The AI Scientist
41:07 Simulated Peer Review
42:46 Healthcare and Lifelong Clinical Coherence
44:40 What Are Humans For? Directors, Not Laborers
46:10 The Credit Assignment Problem
48:39 Governance and Safety for Acting Agents
50:37 Recap: From Concrete Room to Society
52:11 The Final Provocation
53:38 Credits and Outro
This is Heliox: Where Evidence Meets Empathy
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Support the show
Disclosure: This podcast uses AI-generated synthetic voices for a material portion of the audio content, in line with Apple Podcasts guidelines.
We make rigorous science accessible, accurate, and unforgettable.
Produced by Michelle Bruecker and Scott Bleackley, it features reviews of emerging research and ideas from leading thinkers, curated under our creative direction with AI assistance for voice, imagery, and composition. Systemic voices and illustrative images of people are representative tools, not depictions of specific individuals.
We dive deep into peer-reviewed research, pre-prints, and major scientific works—then bring them to life through the stories of the researchers themselves. Complex ideas become clear. Obscure discoveries become conversation starters. And you walk away understanding not just what scientists discovered, but why it matters and how they got there.
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Spoken word, short and sweet, with rhythm and a catchy beat.
http://tinyurl.com/stonefolksongs
Send us Fan Mail
Why are so many offices freezing in July? We can now engineer any indoor temperature, yet millions of us shiver at our desks. This episode unpacks the physics of air conditioning, a "thermal sponge" that moves heat rather than making cold, and the 1998 UC Berkeley study by Richard de Dear and Gail Schiller Brager that changed how we think about comfort.
In this episode:
Listen, read the essay, and support the Heliox community.
References
Understanding Air Conditioner Physics
Developing an Adaptive Model of Thermal Comfort and Preference
📖 Read: https://helioxpodcast.substack.com
🎥 YouTube: https://www.youtube.com/channel/UCd5BbCEeC3Z6dp-nNjWRbBw
🎙️Available for Broadcast: https://exchange.prx.org/group_accounts/253118-heliox_where_evidence_meets_empathy
This is Heliox: Where Evidence Meets Empathy
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Support the show
Disclosure: This podcast uses AI-generated synthetic voices for a material portion of the audio content, in line with Apple Podcasts guidelines.
We make rigorous science accessible, accurate, and unforgettable.
Produced by Michelle Bruecker and Scott Bleackley, it features reviews of emerging research and ideas from leading thinkers, curated under our creative direction with AI assistance for voice, imagery, and composition. Systemic voices and illustrative images of people are representative tools, not depictions of specific individuals.
We dive deep into peer-reviewed research, pre-prints, and major scientific works—then bring them to life through the stories of the researchers themselves. Complex ideas become clear. Obscure discoveries become conversation starters. And you walk away understanding not just what scientists discovered, but why it matters and how they got there.
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Spoken word, short and sweet, with rhythm and a catchy beat.
http://tinyurl.com/stonefolksongs
Send us Fan Mail
📖 Read
How one independent researcher fine-tuned an 8-billion-parameter AI on a 4GB gaming laptop — and uncovered a hidden bug the whole industry had missed.
We make rigorous science accessible, accurate, and unforgettable.
A laptop with 4GB of video memory just fine-tuned an 8-billion-parameter AI model — something conventional machine learning wisdom says is flatly impossible. In this episode, we trace independent researcher Alpamys Makazhan's journey through "Exact Layer Streaming," a technique that outran an enterprise H100 data center GPU, exposed a silent memory-corruption bug buried in a library the entire AI industry relies on, and forced its own author to publicly retract his own explanation when the data proved him wrong.
We dig into the silent failures that can make a training run look successful while learning nothing at all, the detective work that traced a bug through nine discarded hypotheses to its root cause, and the paired experiment that proves this laptop-scale approach produces AI models statistically indistinguishable in quality from ones trained on enterprise supercomputers.
This isn't just a story about optimizing code — it's a story about what happens when a researcher refuses to trust a falling loss curve, and what that kind of scientific integrity means for who gets to build the future of AI.
Reference:
Exact Layer Streaming: LoRA Fine-Tuning of an 8B Model on a 4 GB Laptop GPU (v3). Makazhan, A. (2026)
Chapters
00:00 Intro & The Impossible Challenge: 8B Model, 4GB GPU
02:01 Meet the Paper: Exact Layer Streaming v3
02:55 The Memory Wall Explained
05:08 The Fix: Streaming One Layer at a Time
07:15 Why LoRA Makes Streaming Possible
08:30 The Headline Results
09:57 The Silent Failure Problem
11:43 Trap #2: The Ghost Adapter
13:25 Trap #6: The Corrupted Checkpoint
14:47 Building the Bit-Exact Correctness Protocol
17:43 Scaling to the Data Center: The 32B/72B Anomaly
20:16 Nine Hypotheses, One Culprit
22:10 Finding the NF4 Tripwire
23:24 The Bug in Bits and Bytes
26:41 The Dequantization Fix
28:23 Why the Bug Never Hit the Laptop Benchmark
29:09 The Mystery of Version 3
29:56 The Goliath Test: Laptop Beats H100
31:57 Testing the PCIe Bottleneck Theory
33:28 The Real Bottleneck: Pure Compute
34:33 A Rare Public Retraction
35:47 Streaming vs. the Industry Standard: Head-to-Head with DeepSpeed ZeRO-3
37:36 The Scaling Paradox
38:55 Reframing Layer Streaming as an "Equalizer"
39:35 Side Quest: The Windows WDDM Silent Spill
41:17 Side Quest: The True Cost of Logits
43:19 Side Quest: Gradient Accumulation Myths
45:39 Does Streaming Hurt Model Quality?
47:34 The Verdict: Statistically Indistinguishable
48:45 What This Means for the Future of AI
50:32 Final Questions to Sit With
51:35 Outro
This is Heliox: Where Evidence Meets Empathy
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Support the show
Disclosure: This podcast uses AI-generated synthetic voices for a material portion of the audio content, in line with Apple Podcasts guidelines.
We make rigorous science accessible, accurate, and unforgettable.
Produced by Michelle Bruecker and Scott Bleackley, it features reviews of emerging research and ideas from leading thinkers, curated under our creative direction with AI assistance for voice, imagery, and composition. Systemic voices and illustrative images of people are representative tools, not depictions of specific individuals.
We dive deep into peer-reviewed research, pre-prints, and major scientific works—then bring them to life through the stories of the researchers themselves. Complex ideas become clear. Obscure discoveries become conversation starters. And you walk away understanding not just what scientists discovered, but why it matters and how they got there.
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Spoken word, short and sweet, with rhythm and a catchy beat.
http://tinyurl.com/stonefolksongs
Send us Fan Mail
You step onto a staircase in a city you've never visited. Your neck prickles. You KNOW there's a Picasso hanging on the left at the top.
You've never been here. So why is your brain so sure?
In this episode we put two sources side by side: Cleveland Clinic neurology and Colorado State University cognitive psychology.
Here's what they show:
🧠 Déjà vu is a brief misfire between two memory systems. Familiarity says "I know this!" while recollection can't find the file.
✈️ It's more common in people who travel, study and remember their dreams. It's a sign of a well-stocked mind.
😴 Fatigue, jet lag and stress make it more likely, and persistent déjà vu with confusion or a pounding headache deserves a neurologist.
🎮 Researchers even built déjà vu in a video-game maze, froze it just before the final turn and asked people which way it went. About half felt strong premonition. Their accuracy? A coin flip.
Certainty is real. Foresight isn't. And your brain is doing its best to keep you safe. Listen, read the essay and join the Heliox community. We'd love to hear about your most vivid déjà vu.
📖 Read: https://helioxpodcast.substack.com
🎥 YouTube: https://www.youtube.com/channel/UCd5BbCEeC3Z6dp-nNjWRbBw
🎙️Available for Broadcast: https://exchange.prx.org/group_accounts/253118-heliox_where_evidence_meets_empathy
References
Déjà vu and feelings of prediction: They’re just feelings
That Strange Feeling of Déjà Vu — Explained
This is Heliox: Where Evidence Meets Empathy
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Support the show
Disclosure: This podcast uses AI-generated synthetic voices for a material portion of the audio content, in line with Apple Podcasts guidelines.
We make rigorous science accessible, accurate, and unforgettable.
Produced by Michelle Bruecker and Scott Bleackley, it features reviews of emerging research and ideas from leading thinkers, curated under our creative direction with AI assistance for voice, imagery, and composition. Systemic voices and illustrative images of people are representative tools, not depictions of specific individuals.
We dive deep into peer-reviewed research, pre-prints, and major scientific works—then bring them to life through the stories of the researchers themselves. Complex ideas become clear. Obscure discoveries become conversation starters. And you walk away understanding not just what scientists discovered, but why it matters and how they got there.
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Spoken word, short and sweet, with rhythm and a catchy beat.
http://tinyurl.com/stonefolksongs
Send us Fan Mail
📖 Read: https://helioxpodcast.substack.com/publish/post/218050132
Why teaching neural networks to think in curved, folded space — not flat grids — could cut AI's power bill, stop it from hallucinating, and finally give humans a steering wheel for the black box.
Your AI can write code and pass the bar exam — so why does it also hallucinate, drain a small country's worth of electricity, and turn dead in a huge fraction of its own neurons? This episode traces the answer to a surprisingly simple culprit: for a decade, AI has been forced to process the world using flat, grid-based math that was never built for a curved, rotating, three-dimensional reality. We trace the escape route — a shift toward curved geometry called the Grassmann manifold — through the real engineering that's made it possible, including the GRNet architecture built at ETH Zurich, and follow it all the way to a strange, well-documented phenomenon called grokking, where a stuck model suddenly, physically "clicks" into understanding. Along the way: why models hallucinate, why some neurons quietly die, how researchers turned an O(L²) bottleneck into a linear one, and how this same curved math is starting to hand humans literal sliders to steer AI-generated faces and bodies. Evidence-based, deeply researched, and gently skeptical throughout — this is Heliox: Where Evidence Meets Empathy.
References:
Building Deep Networks on Grassmann Manifolds and twelve other papers
Chapters
00:00 Cold Open: The Shadow on the Wall
02:14 A New Paradigm for AI
04:07 How Euclidean Neural Networks Work
07:18 The Quadratic Scaling Problem
09:33 The Memory Wall
11:00 Dying ReLUs
14:28 Escape Route: The Grassmann Manifold
18:30 Neural Superposition Explained
21:41 The k < n/2 Threshold
23:36 Inside GPT-2's Geometry
29:10 Engineering GRNet
32:22 GDLNet and Linear Scaling
38:05 Grokking: The AI's Aha Moment
45:17 Building a Steering Wheel for AI
53:46 Closing Thought: Is Your Brain a Manifold?
This is Heliox: Where Evidence Meets Empathy
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Support the show
Disclosure: This podcast uses AI-generated synthetic voices for a material portion of the audio content, in line with Apple Podcasts guidelines.
We make rigorous science accessible, accurate, and unforgettable.
Produced by Michelle Bruecker and Scott Bleackley, it features reviews of emerging research and ideas from leading thinkers, curated under our creative direction with AI assistance for voice, imagery, and composition. Systemic voices and illustrative images of people are representative tools, not depictions of specific individuals.
We dive deep into peer-reviewed research, pre-prints, and major scientific works—then bring them to life through the stories of the researchers themselves. Complex ideas become clear. Obscure discoveries become conversation starters. And you walk away understanding not just what scientists discovered, but why it matters and how they got there.
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.
Spoken word, short and sweet, with rhythm and a catchy beat.
http://tinyurl.com/stonefolksongs
From the publisher's feed
We make rigorous science accessible, accurate, and unforgettable.
Produced by Michelle Bruecker and Scott Bleackley, it features reviews of emerging research and ideas from…
We dive deep into peer-reviewed research, pre-prints, and major scientific works—then bring them to life through the stories of the researchers themselves. Complex ideas become clear. Obscure discoveries become conversation starters. And you walk away understanding not just what scientists discovered, but why it matters and how they got there.
Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas.