Brain Inspired

BI 154 Anne Collins: Learning with Working Memory


Listen Later

Check out my free video series about what's missing in AI and Neuroscience

Support the show to get full episodes, full archive, and join the Discord community.

Anne Collins runs her  Computational Cognitive Neuroscience Lab at the University of California, Berkley One of the things she's been working on for years is how our working memory plays a role in learning as well, and specifically how working memory and reinforcement learning interact to affect how we learn, depending on the nature of what we're trying to learn. We discuss that interaction specifically. We also discuss more broadly how segregated and how overlapping and interacting our cognitive functions are, what that implies about our natural tendency to think in dichotomies - like MF vs MB-RL, system-1 vs system-2, etc., and we dive into plenty other subjects, like how to possibly incorporate these ideas into AI.

  • Computational Cognitive Neuroscience Lab.
  • Twitter: @ccnlab or @Anne_On_Tw.
  • Related papers:
    • How Working Memory and Reinforcement Learning Are Intertwined: A Cognitive, Neural, and Computational Perspective
    • Beyond simple dichotomies in reinforcement learning.
    • The Role of Executive Function in Shaping Reinforcement Learning.
    • What do reinforcement learning models measure? Interpreting model parameters in cognition and neuroscience.
    • 0:00 - Intro

      5:25 - Dimensionality of learning
      11:19 - Modularity of function and computations
      16:51 - Is working memory a thing?
      19:33 - Model-free model-based dichotomy
      30:40 - Working memory and RL
      44:43 - How working memory and RL interact
      50:50 - Working memory and attention
      59:37 - Computations vs. implementations
      1:03:25 - Interpreting results
      1:08:00 - Working memory and AI

      ...more
      View all episodesView all episodes
      Download on the App Store

      Brain InspiredBy Paul Middlebrooks

      • 4.8
      • 4.8
      • 4.8
      • 4.8
      • 4.8

      4.8

      134 ratings


      More shows like Brain Inspired

      View all
      Very Bad Wizards by Tamler Sommers & David Pizarro

      Very Bad Wizards

      2,674 Listeners

      Making Sense with Sam Harris by Sam Harris

      Making Sense with Sam Harris

      26,311 Listeners

      Conversations with Tyler by Mercatus Center at George Mason University

      Conversations with Tyler

      2,461 Listeners

      The Quanta Podcast by Quanta Magazine

      The Quanta Podcast

      540 Listeners

      Closer To Truth by Closer To Truth

      Closer To Truth

      247 Listeners

      The Michael Shermer Show by Michael Shermer

      The Michael Shermer Show

      936 Listeners

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

      4,170 Listeners

      The Origins Podcast with Lawrence Krauss by Lawrence M. Krauss

      The Origins Podcast with Lawrence Krauss

      504 Listeners

      Google DeepMind: The Podcast by Hannah Fry

      Google DeepMind: The Podcast

      209 Listeners

      Last Week in AI by Skynet Today

      Last Week in AI

      305 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      97 Listeners

      Dwarkesh Podcast by Dwarkesh Patel

      Dwarkesh Podcast

      528 Listeners

      Theories of Everything with Curt Jaimungal by Theories of Everything

      Theories of Everything with Curt Jaimungal

      26 Listeners

      Clearer Thinking with Spencer Greenberg by Spencer Greenberg

      Clearer Thinking with Spencer Greenberg

      142 Listeners

      Robinson's Podcast by Robinson Erhardt

      Robinson's Podcast

      265 Listeners