Brain Inspired

BI 154 Anne Collins: Learning with Working Memory


Listen Later

Check out my free video series about what's missing in AI and Neuroscience

Support the show to get full episodes, full archive, and join the Discord community.

Anne Collins runs her  Computational Cognitive Neuroscience Lab at the University of California, Berkley One of the things she's been working on for years is how our working memory plays a role in learning as well, and specifically how working memory and reinforcement learning interact to affect how we learn, depending on the nature of what we're trying to learn. We discuss that interaction specifically. We also discuss more broadly how segregated and how overlapping and interacting our cognitive functions are, what that implies about our natural tendency to think in dichotomies - like MF vs MB-RL, system-1 vs system-2, etc., and we dive into plenty other subjects, like how to possibly incorporate these ideas into AI.

  • Computational Cognitive Neuroscience Lab.
  • Twitter: @ccnlab or @Anne_On_Tw.
  • Related papers:
    • How Working Memory and Reinforcement Learning Are Intertwined: A Cognitive, Neural, and Computational Perspective
    • Beyond simple dichotomies in reinforcement learning.
    • The Role of Executive Function in Shaping Reinforcement Learning.
    • What do reinforcement learning models measure? Interpreting model parameters in cognition and neuroscience.
    • 0:00 - Intro

      5:25 - Dimensionality of learning
      11:19 - Modularity of function and computations
      16:51 - Is working memory a thing?
      19:33 - Model-free model-based dichotomy
      30:40 - Working memory and RL
      44:43 - How working memory and RL interact
      50:50 - Working memory and attention
      59:37 - Computations vs. implementations
      1:03:25 - Interpreting results
      1:08:00 - Working memory and AI

      ...more
      View all episodesView all episodes
      Download on the App Store

      Brain InspiredBy Paul Middlebrooks

      • 4.8
      • 4.8
      • 4.8
      • 4.8
      • 4.8

      4.8

      134 ratings


      More shows like Brain Inspired

      View all
      Very Bad Wizards by Tamler Sommers & David Pizarro

      Very Bad Wizards

      2,680 Listeners

      Making Sense with Sam Harris by Sam Harris

      Making Sense with Sam Harris

      26,380 Listeners

      Conversations with Tyler by Mercatus Center at George Mason University

      Conversations with Tyler

      2,461 Listeners

      The Quanta Podcast by Quanta Magazine

      The Quanta Podcast

      544 Listeners

      Closer To Truth by Closer To Truth

      Closer To Truth

      246 Listeners

      The Michael Shermer Show by Michael Shermer

      The Michael Shermer Show

      941 Listeners

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

      4,167 Listeners

      The Origins Podcast with Lawrence Krauss by Lawrence M. Krauss

      The Origins Podcast with Lawrence Krauss

      506 Listeners

      Google DeepMind: The Podcast by Hannah Fry

      Google DeepMind: The Podcast

      203 Listeners

      Last Week in AI by Skynet Today

      Last Week in AI

      313 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      101 Listeners

      Dwarkesh Podcast by Dwarkesh Patel

      Dwarkesh Podcast

      551 Listeners

      Theories of Everything with Curt Jaimungal by Theories of Everything

      Theories of Everything with Curt Jaimungal

      18 Listeners

      Clearer Thinking with Spencer Greenberg by Spencer Greenberg

      Clearer Thinking with Spencer Greenberg

      137 Listeners

      Robinson's Podcast by Robinson Erhardt

      Robinson's Podcast

      270 Listeners