Brain Inspired

BI 139 Marc Howard: Compressed Time and Memory


Listen Later

Check out my free video series about what's missing in AI and Neuroscience

Support the show to get full episodes, full archive, and join the Discord community.

Marc Howard runs his Theoretical Cognitive Neuroscience Lab at Boston University, where he develops mathematical models of cognition, constrained by psychological and neural data. In this episode, we discuss the idea that a Laplace transform and its inverse may serve as a unified framework for memory. In short, our memories are compressed on a continuous log-scale: as memories get older, their representations "spread out" in time. It turns out this kind of representation seems ubiquitous in the brain and across cognitive functions, suggesting it is likely a canonical computation our brains use to represent a wide variety of cognitive functions. We also discuss some of the ways Marc is incorporating this mathematical operation in deep learning nets to improve their ability to handle information at different time scales.

  • Theoretical Cognitive Neuroscience Lab
  • Twitter: @marcwhoward777.
  • Related papers:
    • Memory as perception of the past: Compressed time in mind and brain.
    • Formal models of memory based on temporally-varying representations.
    • Cognitive computation using neural representations of time and space in the Laplace domain.
    • Time as a continuous dimension in natural and artificial networks.
    • DeepSITH: Efficient learning via decomposition of what and when across time scales.
    • 0:00 - Intro

      4:57 - Main idea: Laplace transforms
      12:00 - Time cells
      20:08 - Laplace, compression, and time cells
      25:34 - Everywhere in the brain
      29:28 - Episodic memory
      35:11 - Randy Gallistel's memory idea
      40:37 - Adding Laplace to deep nets
      48:04 - Reinforcement learning
      1:00:52 - Brad Wyble Q: What gets filtered out?
      1:05:38 - Replay and complementary learning systems
      1:11:52 - Howard Goldowsky Q: Gyorgy Buzsaki
      1:15:10 - Obstacles

      ...more
      View all episodesView all episodes
      Download on the App Store

      Brain InspiredBy Paul Middlebrooks

      • 4.9
      • 4.9
      • 4.9
      • 4.9
      • 4.9

      4.9

      128 ratings


      More shows like Brain Inspired

      View all
      Making Sense with Sam Harris by Sam Harris

      Making Sense with Sam Harris

      26,300 Listeners

      Into the Impossible With Brian Keating by Big Bang Productions Inc.

      Into the Impossible With Brian Keating

      1,031 Listeners

      80,000 Hours Podcast by Rob, Luisa, and the 80,000 Hours team

      80,000 Hours Podcast

      289 Listeners

      The Michael Shermer Show by Michael Shermer

      The Michael Shermer Show

      899 Listeners

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

      4,076 Listeners

      Your Undivided Attention by Tristan Harris and Aza Raskin, The Center for Humane Technology

      Your Undivided Attention

      1,428 Listeners

      The Jim Rutt Show by The Jim Rutt Show

      The Jim Rutt Show

      248 Listeners

      Google DeepMind: The Podcast by Hannah Fry

      Google DeepMind: The Podcast

      190 Listeners

      COMPLEXITY by Santa Fe Institute

      COMPLEXITY

      279 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      90 Listeners

      Dwarkesh Podcast by Dwarkesh Patel

      Dwarkesh Podcast

      321 Listeners

      Clearer Thinking with Spencer Greenberg by Spencer Greenberg

      Clearer Thinking with Spencer Greenberg

      137 Listeners

      The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

      The Joy of Why

      457 Listeners

      Robinson's Podcast by Robinson Erhardt

      Robinson's Podcast

      194 Listeners

      Theoretical Neuroscience Podcast by Gaute Einevoll

      Theoretical Neuroscience Podcast

      6 Listeners