Brain Inspired

BI 139 Marc Howard: Compressed Time and Memory


Listen Later

Check out my free video series about what's missing in AI and Neuroscience

Support the show to get full episodes, full archive, and join the Discord community.

Marc Howard runs his Theoretical Cognitive Neuroscience Lab at Boston University, where he develops mathematical models of cognition, constrained by psychological and neural data. In this episode, we discuss the idea that a Laplace transform and its inverse may serve as a unified framework for memory. In short, our memories are compressed on a continuous log-scale: as memories get older, their representations "spread out" in time. It turns out this kind of representation seems ubiquitous in the brain and across cognitive functions, suggesting it is likely a canonical computation our brains use to represent a wide variety of cognitive functions. We also discuss some of the ways Marc is incorporating this mathematical operation in deep learning nets to improve their ability to handle information at different time scales.

  • Theoretical Cognitive Neuroscience Lab
  • Twitter: @marcwhoward777.
  • Related papers:
    • Memory as perception of the past: Compressed time in mind and brain.
    • Formal models of memory based on temporally-varying representations.
    • Cognitive computation using neural representations of time and space in the Laplace domain.
    • Time as a continuous dimension in natural and artificial networks.
    • DeepSITH: Efficient learning via decomposition of what and when across time scales.
    • 0:00 - Intro

      4:57 - Main idea: Laplace transforms
      12:00 - Time cells
      20:08 - Laplace, compression, and time cells
      25:34 - Everywhere in the brain
      29:28 - Episodic memory
      35:11 - Randy Gallistel's memory idea
      40:37 - Adding Laplace to deep nets
      48:04 - Reinforcement learning
      1:00:52 - Brad Wyble Q: What gets filtered out?
      1:05:38 - Replay and complementary learning systems
      1:11:52 - Howard Goldowsky Q: Gyorgy Buzsaki
      1:15:10 - Obstacles

      ...more
      View all episodesView all episodes
      Download on the App Store

      Brain InspiredBy Paul Middlebrooks

      • 4.8
      • 4.8
      • 4.8
      • 4.8
      • 4.8

      4.8

      134 ratings


      More shows like Brain Inspired

      View all
      Very Bad Wizards by Tamler Sommers & David Pizarro

      Very Bad Wizards

      2,673 Listeners

      Nature Podcast by Springer Nature Limited

      Nature Podcast

      761 Listeners

      The Quanta Podcast by Quanta Magazine

      The Quanta Podcast

      523 Listeners

      The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

      The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

      431 Listeners

      Philosophy For Our Times by IAI

      Philosophy For Our Times

      315 Listeners

      Future of Life Institute Podcast by Future of Life Institute

      Future of Life Institute Podcast

      107 Listeners

      The Good Fight by Yascha Mounk

      The Good Fight

      900 Listeners

      The Michael Shermer Show by Michael Shermer

      The Michael Shermer Show

      931 Listeners

      Big Brains by University of Chicago Podcast Network

      Big Brains

      480 Listeners

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

      4,152 Listeners

      The Origins Podcast with Lawrence Krauss by Lawrence M. Krauss

      The Origins Podcast with Lawrence Krauss

      504 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      90 Listeners

      Dwarkesh Podcast by Dwarkesh Patel

      Dwarkesh Podcast

      505 Listeners

      Clearer Thinking with Spencer Greenberg by Spencer Greenberg

      Clearer Thinking with Spencer Greenberg

      139 Listeners

      The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

      The Joy of Why

      491 Listeners