Brain Inspired

BI 193 Kim Stachenfeld: Enhancing Neuroscience and AI


Listen Later

Support the show to get full episodes, full archive, and join the Discord community.

The Transmitter is an online publication that aims to deliver useful information, insights and tools to build bridges across neuroscience and advance research. Visit thetransmitter.org to explore the latest neuroscience news and perspectives, written by journalists and scientists. 

Read more about our partnership.

Check out this story:  Monkeys build mental maps to navigate new tasks

Sign up for “Brain Inspired” email alerts to be notified every time a new “Brain Inspired” episode is released.

To explore more neuroscience news and perspectives, visit thetransmitter.org.

Kim Stachenfeld embodies the original core focus of this podcast, the exploration of the intersection between neuroscience and AI, now commonly known as Neuro-AI. That's because she walks both lines. Kim is a Senior Research Scientist at Google DeepMind, the AI company that sprang from neuroscience principles, and also does research at the Center for Theoretical Neuroscience at Columbia University. She's been using her expertise in modeling, and reinforcement learning, and cognitive maps, for example, to help understand brains and to help improve AI. I've been wanting to have her on for a long time to get her broad perspective on AI and neuroscience.

We discuss the relative roles of industry and academia in pursuing various objectives related to understanding and building cognitive entities

She's studied the hippocampus in her research on reinforcement learning and cognitive maps, so we discuss what the heck the hippocampus does since it seems to implicated in so many functions, and how she thinks of reinforcement learning these days.

Most recently Kim at Deepmind has focused on more practical engineering questions, using deep learning models to predict things like chaotic turbulent flows, and even to help design things like bridges and airplanes. And we don't get into the specifics of that work, but, given that I just spoke with Damian Kelty-Stephen, who thinks of brains partially as turbulent cascades, Kim and I discuss how her work on modeling turbulence has shaped her thoughts about brains.

  • Kim's website.
  • Twitter: @neuro_kim.
  • Related papers
    • Scaling Laws for Neural Language Models.
    • Emergent Abilities of Large Language Models.
    • Learned simulators:
      • Learned coarse models for efficient turbulence simulation.
      • Physical design using differentiable learned simulators.
      • Check out the transcript, provided by The Transmitter.

        0:00 - Intro

        4:31 - Deepmind's original and current vision
        9:53 - AI as tools and models
        12:53 - Has AI hindered neuroscience?
        17:05 - Deepmind vs academic work balance
        20:47 - Is industry better suited to understand brains?
        24?42 - Trajectory of Deepmind
        27:41 - Kim's trajectory
        33:35 - Is the brain a ML entity?
        36:12 - Hippocampus
        44:12 - Reinforcement learning
        51:32 - What does neuroscience need more and less of?
        1:02:53 - Neuroscience in a weird place?
        1:06:41 - How Kim's questions have changed
        1:16:31 - Intelligence and LLMs
        1:25:34 - Challenges

        ...more
        View all episodesView all episodes
        Download on the App Store

        Brain InspiredBy Paul Middlebrooks

        • 4.8
        • 4.8
        • 4.8
        • 4.8
        • 4.8

        4.8

        134 ratings


        More shows like Brain Inspired

        View all
        Nature Podcast by Springer Nature Limited

        Nature Podcast

        760 Listeners

        Very Bad Wizards by Tamler Sommers & David Pizarro

        Very Bad Wizards

        2,657 Listeners

        The Quanta Podcast by Quanta Magazine

        The Quanta Podcast

        508 Listeners

        The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

        The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

        436 Listeners

        Philosophy For Our Times by IAI

        Philosophy For Our Times

        305 Listeners

        Future of Life Institute Podcast by Future of Life Institute

        Future of Life Institute Podcast

        107 Listeners

        The Good Fight by Yascha Mounk

        The Good Fight

        895 Listeners

        The Michael Shermer Show by Michael Shermer

        The Michael Shermer Show

        919 Listeners

        Big Brains by University of Chicago Podcast Network

        Big Brains

        470 Listeners

        Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

        Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

        4,124 Listeners

        The Origins Podcast with Lawrence Krauss by Lawrence M. Krauss

        The Origins Podcast with Lawrence Krauss

        509 Listeners

        Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

        Machine Learning Street Talk (MLST)

        92 Listeners

        Dwarkesh Podcast by Dwarkesh Patel

        Dwarkesh Podcast

        427 Listeners

        Clearer Thinking with Spencer Greenberg by Spencer Greenberg

        Clearer Thinking with Spencer Greenberg

        133 Listeners

        The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

        The Joy of Why

        505 Listeners