Brain Inspired

BI 154 Anne Collins: Learning with Working Memory


Listen Later

Check out my free video series about what's missing in AI and Neuroscience

Support the show to get full episodes, full archive, and join the Discord community.

Anne Collins runs her  Computational Cognitive Neuroscience Lab at the University of California, Berkley One of the things she's been working on for years is how our working memory plays a role in learning as well, and specifically how working memory and reinforcement learning interact to affect how we learn, depending on the nature of what we're trying to learn. We discuss that interaction specifically. We also discuss more broadly how segregated and how overlapping and interacting our cognitive functions are, what that implies about our natural tendency to think in dichotomies - like MF vs MB-RL, system-1 vs system-2, etc., and we dive into plenty other subjects, like how to possibly incorporate these ideas into AI.

  • Computational Cognitive Neuroscience Lab.
  • Twitter: @ccnlab or @Anne_On_Tw.
  • Related papers:
    • How Working Memory and Reinforcement Learning Are Intertwined: A Cognitive, Neural, and Computational Perspective
    • Beyond simple dichotomies in reinforcement learning.
    • The Role of Executive Function in Shaping Reinforcement Learning.
    • What do reinforcement learning models measure? Interpreting model parameters in cognition and neuroscience.
    • 0:00 - Intro

      5:25 - Dimensionality of learning
      11:19 - Modularity of function and computations
      16:51 - Is working memory a thing?
      19:33 - Model-free model-based dichotomy
      30:40 - Working memory and RL
      44:43 - How working memory and RL interact
      50:50 - Working memory and attention
      59:37 - Computations vs. implementations
      1:03:25 - Interpreting results
      1:08:00 - Working memory and AI

      ...more
      View all episodesView all episodes
      Download on the App Store

      Brain InspiredBy Paul Middlebrooks

      • 4.9
      • 4.9
      • 4.9
      • 4.9
      • 4.9

      4.9

      133 ratings


      More shows like Brain Inspired

      View all
      History of Philosophy Without Any Gaps by Peter Adamson

      History of Philosophy Without Any Gaps

      1,579 Listeners

      Closer To Truth by Closer To Truth

      Closer To Truth

      242 Listeners

      Philosophize This! by Stephen West

      Philosophize This!

      15,037 Listeners

      The Quanta Podcast by Quanta Magazine

      The Quanta Podcast

      482 Listeners

      Philosophy For Our Times by IAI

      Philosophy For Our Times

      307 Listeners

      Into the Impossible With Brian Keating by Big Bang Productions Inc.

      Into the Impossible With Brian Keating

      1,043 Listeners

      The Michael Shermer Show by Michael Shermer

      The Michael Shermer Show

      918 Listeners

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

      4,131 Listeners

      The Origins Podcast with Lawrence Krauss by Lawrence M. Krauss

      The Origins Podcast with Lawrence Krauss

      486 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      88 Listeners

      Dwarkesh Podcast by Dwarkesh Patel

      Dwarkesh Podcast

      379 Listeners

      Theories of Everything with Curt Jaimungal by Theories of Everything

      Theories of Everything with Curt Jaimungal

      459 Listeners

      Clearer Thinking with Spencer Greenberg by Spencer Greenberg

      Clearer Thinking with Spencer Greenberg

      128 Listeners

      The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

      The Joy of Why

      498 Listeners

      Robinson's Podcast by Robinson Erhardt

      Robinson's Podcast

      242 Listeners