Brain Inspired

BI 088 Randy O’Reilly: Simulating the Human Brain


Listen Later

Randy and I discuss his LEABRA cognitive architecture that aims to simulate the human brain, plus his current theory about how a loop between cortical regions and the thalamus could implement predictive learning and thus solve how we learn with so few examples. We also discuss what Randy thinks is the next big thing neuroscience can contribute to AI (thanks to a guest question from Anna Schapiro), and much more.

  • Computational Cognitive Neuroscience Laboratory.
  • The papers we discuss or mention:
    • The Leabra Cognitive Architecture: How to Play 20 Principles with Nature and Win!
    • Deep Predictive Learning in Neocortex and Pulvinar.
    • Unraveling the Mysteries of Motivation.
  • His youTube series detailing the theory and workings of Leabra:
    • Computational Cognitive Neuroscience.
  • The free textbook:
    • Computational Cognitive Neuroscience

A few take-home points:

  • Leabra has been a slow incremental project, inspired in part by Alan Newell’s suggested approach.
  • Randy began by developing a learning algorithm that incorporated both kinds of biological learning (error-driven and associative).
  • Leabra's core is 3 brain areas - frontal cortex, parietal cortex, and hippocampus - and has grown from there.
  • There’s a constant balance between biological realism and computational feasibility.
  • It’s important that a cognitive architecture address multiple levels- micro-scale, macro-scale, mechanisms, functions, and so on.
  • Deep predictive learning is a possible brain mechanism whereby predictions from higher layer cortex precede input from lower layer cortex in the thalamus, where an error is computed and used to drive learning.
  • Randy believes our metacognitive ability to know what we do and don’t know is a key next function to build into AI.

Timestamps:

0:00 -  Intro 
3:54 - Skip Intro 
6:20 - Being in awe 
18:57 - How current AI can inform neuro 
21:56 - Anna Schapiro question - how current neuro can inform AI.
29:20 - Learned vs. innate cognition 
33:43 - LEABRA 
38:33 - Developing Leabra 
40:30 - Macroscale
42:33 - Thalamus as microscale 
43:22 - Thalamocortical circuitry 
47:25 - Deep predictive learning 
56:18 - Deep predictive learning vs. backrop 
1:01:56 - 10 Hz learning cycle 
1:04:58 - Better theory vs. more data 
1:08:59 - Leabra vs. Spaun 
1:13:59 - Biological realism 
1:21:54 - Bottom-up inspiration 
1:27:26 - Biggest mistake in Leabra 
1:32:14 - AI consciousness 
1:34:45 - How would Randy begin again? 

...more
View all episodesView all episodes
Download on the App Store

Brain InspiredBy Paul Middlebrooks

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

134 ratings


More shows like Brain Inspired

View all
Very Bad Wizards by Tamler Sommers & David Pizarro

Very Bad Wizards

2,673 Listeners

Nature Podcast by Springer Nature Limited

Nature Podcast

761 Listeners

The Quanta Podcast by Quanta Magazine

The Quanta Podcast

526 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

431 Listeners

Philosophy For Our Times by IAI

Philosophy For Our Times

315 Listeners

Future of Life Institute Podcast by Future of Life Institute

Future of Life Institute Podcast

107 Listeners

The Good Fight by Yascha Mounk

The Good Fight

900 Listeners

The Michael Shermer Show by Michael Shermer

The Michael Shermer Show

931 Listeners

Big Brains by University of Chicago Podcast Network

Big Brains

480 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,152 Listeners

The Origins Podcast with Lawrence Krauss by Lawrence M. Krauss

The Origins Podcast with Lawrence Krauss

504 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

95 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

505 Listeners

Clearer Thinking with Spencer Greenberg by Spencer Greenberg

Clearer Thinking with Spencer Greenberg

139 Listeners

The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

The Joy of Why

491 Listeners