Brain Inspired

BI 154 Anne Collins: Learning with Working Memory


Listen Later

Check out my free video series about what's missing in AI and Neuroscience

Support the show to get full episodes, full archive, and join the Discord community.

Anne Collins runs her  Computational Cognitive Neuroscience Lab at the University of California, Berkley One of the things she's been working on for years is how our working memory plays a role in learning as well, and specifically how working memory and reinforcement learning interact to affect how we learn, depending on the nature of what we're trying to learn. We discuss that interaction specifically. We also discuss more broadly how segregated and how overlapping and interacting our cognitive functions are, what that implies about our natural tendency to think in dichotomies - like MF vs MB-RL, system-1 vs system-2, etc., and we dive into plenty other subjects, like how to possibly incorporate these ideas into AI.

  • Computational Cognitive Neuroscience Lab.
  • Twitter: @ccnlab or @Anne_On_Tw.
  • Related papers:
    • How Working Memory and Reinforcement Learning Are Intertwined: A Cognitive, Neural, and Computational Perspective
    • Beyond simple dichotomies in reinforcement learning.
    • The Role of Executive Function in Shaping Reinforcement Learning.
    • What do reinforcement learning models measure? Interpreting model parameters in cognition and neuroscience.
    • 0:00 - Intro

      5:25 - Dimensionality of learning
      11:19 - Modularity of function and computations
      16:51 - Is working memory a thing?
      19:33 - Model-free model-based dichotomy
      30:40 - Working memory and RL
      44:43 - How working memory and RL interact
      50:50 - Working memory and attention
      59:37 - Computations vs. implementations
      1:03:25 - Interpreting results
      1:08:00 - Working memory and AI

      ...more
      View all episodesView all episodes
      Download on the App Store

      Brain InspiredBy Paul Middlebrooks

      • 4.8
      • 4.8
      • 4.8
      • 4.8
      • 4.8

      4.8

      134 ratings


      More shows like Brain Inspired

      View all
      Very Bad Wizards by Tamler Sommers & David Pizarro

      Very Bad Wizards

      2,673 Listeners

      Nature Podcast by Springer Nature Limited

      Nature Podcast

      761 Listeners

      The Quanta Podcast by Quanta Magazine

      The Quanta Podcast

      523 Listeners

      The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

      The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

      431 Listeners

      Philosophy For Our Times by IAI

      Philosophy For Our Times

      315 Listeners

      Future of Life Institute Podcast by Future of Life Institute

      Future of Life Institute Podcast

      107 Listeners

      The Good Fight by Yascha Mounk

      The Good Fight

      900 Listeners

      The Michael Shermer Show by Michael Shermer

      The Michael Shermer Show

      931 Listeners

      Big Brains by University of Chicago Podcast Network

      Big Brains

      480 Listeners

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

      4,152 Listeners

      The Origins Podcast with Lawrence Krauss by Lawrence M. Krauss

      The Origins Podcast with Lawrence Krauss

      504 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      90 Listeners

      Dwarkesh Podcast by Dwarkesh Patel

      Dwarkesh Podcast

      505 Listeners

      Clearer Thinking with Spencer Greenberg by Spencer Greenberg

      Clearer Thinking with Spencer Greenberg

      139 Listeners

      The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

      The Joy of Why

      491 Listeners