Brain Inspired

BI 201 Rajesh Rao: From Predictive Coding to Brain Co-Processors


Listen Later

Support the show to get full episodes, full archive, and join the Discord community.

Today I'm in conversation with Rajesh Rao, a distinguished professor of computer science and engineering at the University of Washington, where he also co-directs the Center for Neurotechnology. Back in 1999, Raj and Dana Ballard published what became quite a famous paper, which proposed how predictive coding might be implemented in brains. What is predictive coding, you may be wondering? It's roughly the idea that your brain is constantly predicting incoming sensory signals, and it generates that prediction as a top-down signal that meets the bottom-up sensory signals. Then the brain computes a difference between the prediction and the actual sensory input, and that difference is sent back up to the "top" where the brain then updates its internal model to make better future predictions.

So that was 25 years ago, and it was focused on how the brain handles sensory information. But Raj just recently published an update to the predictive coding framework, one that incorporates actions and perception, suggests how it might be implemented in the cortex - specifically which cortical layers do what - something he calls "Active predictive coding." So we discuss that new proposal, we also talk about his engineering work on brain-computer interface technologies, like BrainNet, which basically connects two brains together, and like neural co-processors, which use an artificial neural network as a prosthetic that can do things like enhance memories, optimize learning, and help restore brain function after strokes, for example. Finally, we discuss Raj's interest and work on deciphering an ancient Indian text, the mysterious Indus script.

  • Raj's website.
  • Twitter: @RajeshPNRao.
  • Related papers
    • A sensory–motor theory of the neocortex.
    • Brain co-processors: using AI to restore and augment brain function.
    • Towards neural co-processors for the brain: combining decoding and encoding in brain–computer interfaces.
    • BrainNet: A Multi-Person Brain-to-Brain Interface for Direct Collaboration Between Brains.
    • Read the transcript.

      0:00 - Intro

      7:40 - Predictive coding origins
      16:14 - Early appreciation of recurrence
      17:08 - Prediction as a general theory of the brain
      18:38 - Rao and Ballard 1999
      26:32 - Prediction as a general theory of the brain
      33:24 - Perception vs action
      33:28 - Active predictive coding
      45:04 - Evolving to augment our brains
      53:03 - BrainNet
      57:12 - Neural co-processors
      1:11:19 - Decoding the Indus Script
      1:20:18 - Transformer models relation to active predictive coding

      ...more
      View all episodesView all episodes
      Download on the App Store

      Brain InspiredBy Paul Middlebrooks

      • 4.9
      • 4.9
      • 4.9
      • 4.9
      • 4.9

      4.9

      128 ratings


      More shows like Brain Inspired

      View all
      Making Sense with Sam Harris by Sam Harris

      Making Sense with Sam Harris

      26,286 Listeners

      Into the Impossible With Brian Keating by Big Bang Productions Inc.

      Into the Impossible With Brian Keating

      1,035 Listeners

      80,000 Hours Podcast by Rob, Luisa, and the 80,000 Hours team

      80,000 Hours Podcast

      290 Listeners

      The Michael Shermer Show by Michael Shermer

      The Michael Shermer Show

      894 Listeners

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

      4,097 Listeners

      Your Undivided Attention by Tristan Harris and Aza Raskin, The Center for Humane Technology

      Your Undivided Attention

      1,412 Listeners

      The Jim Rutt Show by The Jim Rutt Show

      The Jim Rutt Show

      254 Listeners

      Google DeepMind: The Podcast by Hannah Fry

      Google DeepMind: The Podcast

      188 Listeners

      COMPLEXITY by Santa Fe Institute

      COMPLEXITY

      279 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      92 Listeners

      Dwarkesh Podcast by Dwarkesh Patel

      Dwarkesh Podcast

      315 Listeners

      Clearer Thinking with Spencer Greenberg by Spencer Greenberg

      Clearer Thinking with Spencer Greenberg

      131 Listeners

      The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

      The Joy of Why

      424 Listeners

      Robinson's Podcast by Robinson Erhardt

      Robinson's Podcast

      193 Listeners

      Theoretical Neuroscience Podcast by Gaute Einevoll

      Theoretical Neuroscience Podcast

      7 Listeners