Brain Inspired

BI 139 Marc Howard: Compressed Time and Memory


Listen Later

Check out my free video series about what's missing in AI and Neuroscience

Support the show to get full episodes, full archive, and join the Discord community.

Marc Howard runs his Theoretical Cognitive Neuroscience Lab at Boston University, where he develops mathematical models of cognition, constrained by psychological and neural data. In this episode, we discuss the idea that a Laplace transform and its inverse may serve as a unified framework for memory. In short, our memories are compressed on a continuous log-scale: as memories get older, their representations "spread out" in time. It turns out this kind of representation seems ubiquitous in the brain and across cognitive functions, suggesting it is likely a canonical computation our brains use to represent a wide variety of cognitive functions. We also discuss some of the ways Marc is incorporating this mathematical operation in deep learning nets to improve their ability to handle information at different time scales.

  • Theoretical Cognitive Neuroscience Lab
  • Twitter: @marcwhoward777.
  • Related papers:
    • Memory as perception of the past: Compressed time in mind and brain.
    • Formal models of memory based on temporally-varying representations.
    • Cognitive computation using neural representations of time and space in the Laplace domain.
    • Time as a continuous dimension in natural and artificial networks.
    • DeepSITH: Efficient learning via decomposition of what and when across time scales.
    • 0:00 - Intro

      4:57 - Main idea: Laplace transforms
      12:00 - Time cells
      20:08 - Laplace, compression, and time cells
      25:34 - Everywhere in the brain
      29:28 - Episodic memory
      35:11 - Randy Gallistel's memory idea
      40:37 - Adding Laplace to deep nets
      48:04 - Reinforcement learning
      1:00:52 - Brad Wyble Q: What gets filtered out?
      1:05:38 - Replay and complementary learning systems
      1:11:52 - Howard Goldowsky Q: Gyorgy Buzsaki
      1:15:10 - Obstacles

      ...more
      View all episodesView all episodes
      Download on the App Store

      Brain InspiredBy Paul Middlebrooks

      • 4.8
      • 4.8
      • 4.8
      • 4.8
      • 4.8

      4.8

      134 ratings


      More shows like Brain Inspired

      View all
      Very Bad Wizards by Tamler Sommers & David Pizarro

      Very Bad Wizards

      2,674 Listeners

      Making Sense with Sam Harris by Sam Harris

      Making Sense with Sam Harris

      26,308 Listeners

      Conversations with Tyler by Mercatus Center at George Mason University

      Conversations with Tyler

      2,460 Listeners

      The Quanta Podcast by Quanta Magazine

      The Quanta Podcast

      540 Listeners

      Closer To Truth by Closer To Truth

      Closer To Truth

      247 Listeners

      The Michael Shermer Show by Michael Shermer

      The Michael Shermer Show

      938 Listeners

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

      4,174 Listeners

      The Origins Podcast with Lawrence Krauss by Lawrence M. Krauss

      The Origins Podcast with Lawrence Krauss

      505 Listeners

      Google DeepMind: The Podcast by Hannah Fry

      Google DeepMind: The Podcast

      208 Listeners

      Last Week in AI by Skynet Today

      Last Week in AI

      304 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      97 Listeners

      Dwarkesh Podcast by Dwarkesh Patel

      Dwarkesh Podcast

      531 Listeners

      Theories of Everything with Curt Jaimungal by Theories of Everything

      Theories of Everything with Curt Jaimungal

      26 Listeners

      Clearer Thinking with Spencer Greenberg by Spencer Greenberg

      Clearer Thinking with Spencer Greenberg

      142 Listeners

      Robinson's Podcast by Robinson Erhardt

      Robinson's Podcast

      265 Listeners