Brain Inspired

BI 139 Marc Howard: Compressed Time and Memory


Listen Later

Check out my free video series about what's missing in AI and Neuroscience

Support the show to get full episodes, full archive, and join the Discord community.

Marc Howard runs his Theoretical Cognitive Neuroscience Lab at Boston University, where he develops mathematical models of cognition, constrained by psychological and neural data. In this episode, we discuss the idea that a Laplace transform and its inverse may serve as a unified framework for memory. In short, our memories are compressed on a continuous log-scale: as memories get older, their representations "spread out" in time. It turns out this kind of representation seems ubiquitous in the brain and across cognitive functions, suggesting it is likely a canonical computation our brains use to represent a wide variety of cognitive functions. We also discuss some of the ways Marc is incorporating this mathematical operation in deep learning nets to improve their ability to handle information at different time scales.

  • Theoretical Cognitive Neuroscience Lab
  • Twitter: @marcwhoward777.
  • Related papers:
    • Memory as perception of the past: Compressed time in mind and brain.
    • Formal models of memory based on temporally-varying representations.
    • Cognitive computation using neural representations of time and space in the Laplace domain.
    • Time as a continuous dimension in natural and artificial networks.
    • DeepSITH: Efficient learning via decomposition of what and when across time scales.
    • 0:00 - Intro

      4:57 - Main idea: Laplace transforms
      12:00 - Time cells
      20:08 - Laplace, compression, and time cells
      25:34 - Everywhere in the brain
      29:28 - Episodic memory
      35:11 - Randy Gallistel's memory idea
      40:37 - Adding Laplace to deep nets
      48:04 - Reinforcement learning
      1:00:52 - Brad Wyble Q: What gets filtered out?
      1:05:38 - Replay and complementary learning systems
      1:11:52 - Howard Goldowsky Q: Gyorgy Buzsaki
      1:15:10 - Obstacles

      ...more
      View all episodesView all episodes
      Download on the App Store

      Brain InspiredBy Paul Middlebrooks

      • 4.9
      • 4.9
      • 4.9
      • 4.9
      • 4.9

      4.9

      133 ratings


      More shows like Brain Inspired

      View all
      History of Philosophy Without Any Gaps by Peter Adamson

      History of Philosophy Without Any Gaps

      1,579 Listeners

      Closer To Truth by Closer To Truth

      Closer To Truth

      242 Listeners

      Philosophize This! by Stephen West

      Philosophize This!

      15,037 Listeners

      The Quanta Podcast by Quanta Magazine

      The Quanta Podcast

      482 Listeners

      Philosophy For Our Times by IAI

      Philosophy For Our Times

      307 Listeners

      Into the Impossible With Brian Keating by Big Bang Productions Inc.

      Into the Impossible With Brian Keating

      1,043 Listeners

      The Michael Shermer Show by Michael Shermer

      The Michael Shermer Show

      918 Listeners

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

      4,131 Listeners

      The Origins Podcast with Lawrence Krauss by Lawrence M. Krauss

      The Origins Podcast with Lawrence Krauss

      486 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      88 Listeners

      Dwarkesh Podcast by Dwarkesh Patel

      Dwarkesh Podcast

      379 Listeners

      Theories of Everything with Curt Jaimungal by Theories of Everything

      Theories of Everything with Curt Jaimungal

      459 Listeners

      Clearer Thinking with Spencer Greenberg by Spencer Greenberg

      Clearer Thinking with Spencer Greenberg

      128 Listeners

      The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

      The Joy of Why

      498 Listeners

      Robinson's Podcast by Robinson Erhardt

      Robinson's Podcast

      242 Listeners