Brain Inspired

BI 154 Anne Collins: Learning with Working Memory


Listen Later

Check out my free video series about what's missing in AI and Neuroscience

Support the show to get full episodes, full archive, and join the Discord community.

Anne Collins runs her  Computational Cognitive Neuroscience Lab at the University of California, Berkley One of the things she's been working on for years is how our working memory plays a role in learning as well, and specifically how working memory and reinforcement learning interact to affect how we learn, depending on the nature of what we're trying to learn. We discuss that interaction specifically. We also discuss more broadly how segregated and how overlapping and interacting our cognitive functions are, what that implies about our natural tendency to think in dichotomies - like MF vs MB-RL, system-1 vs system-2, etc., and we dive into plenty other subjects, like how to possibly incorporate these ideas into AI.

  • Computational Cognitive Neuroscience Lab.
  • Twitter: @ccnlab or @Anne_On_Tw.
  • Related papers:
    • How Working Memory and Reinforcement Learning Are Intertwined: A Cognitive, Neural, and Computational Perspective
    • Beyond simple dichotomies in reinforcement learning.
    • The Role of Executive Function in Shaping Reinforcement Learning.
    • What do reinforcement learning models measure? Interpreting model parameters in cognition and neuroscience.
    • 0:00 - Intro

      5:25 - Dimensionality of learning
      11:19 - Modularity of function and computations
      16:51 - Is working memory a thing?
      19:33 - Model-free model-based dichotomy
      30:40 - Working memory and RL
      44:43 - How working memory and RL interact
      50:50 - Working memory and attention
      59:37 - Computations vs. implementations
      1:03:25 - Interpreting results
      1:08:00 - Working memory and AI

      ...more
      View all episodesView all episodes
      Download on the App Store

      Brain InspiredBy Paul Middlebrooks

      • 4.9
      • 4.9
      • 4.9
      • 4.9
      • 4.9

      4.9

      128 ratings


      More shows like Brain Inspired

      View all
      Making Sense with Sam Harris by Sam Harris

      Making Sense with Sam Harris

      26,300 Listeners

      Into the Impossible With Brian Keating by Big Bang Productions Inc.

      Into the Impossible With Brian Keating

      1,031 Listeners

      80,000 Hours Podcast by Rob, Luisa, and the 80,000 Hours team

      80,000 Hours Podcast

      289 Listeners

      The Michael Shermer Show by Michael Shermer

      The Michael Shermer Show

      899 Listeners

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

      4,076 Listeners

      Your Undivided Attention by Tristan Harris and Aza Raskin, The Center for Humane Technology

      Your Undivided Attention

      1,428 Listeners

      The Jim Rutt Show by The Jim Rutt Show

      The Jim Rutt Show

      248 Listeners

      Google DeepMind: The Podcast by Hannah Fry

      Google DeepMind: The Podcast

      190 Listeners

      COMPLEXITY by Santa Fe Institute

      COMPLEXITY

      279 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      90 Listeners

      Dwarkesh Podcast by Dwarkesh Patel

      Dwarkesh Podcast

      321 Listeners

      Clearer Thinking with Spencer Greenberg by Spencer Greenberg

      Clearer Thinking with Spencer Greenberg

      137 Listeners

      The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

      The Joy of Why

      457 Listeners

      Robinson's Podcast by Robinson Erhardt

      Robinson's Podcast

      194 Listeners

      Theoretical Neuroscience Podcast by Gaute Einevoll

      Theoretical Neuroscience Podcast

      6 Listeners