Brain Inspired

BI 183 Dan Goodman: Neural Reckoning


Listen Later

Support the show to get full episodes, full archive, and join the Discord community.

You may know my guest as the co-founder of Neuromatch, the excellent online computational neuroscience academy, or as the creator of the Brian spiking neural network simulator, which is freely available. I know him as a spiking neural network practitioner extraordinaire. Dan Goodman runs the Neural Reckoning Group at Imperial College London, where they use spiking neural networks to figure out how biological and artificial brains reckon, or compute.

All of the current AI we use to do all the impressive things we do, essentially all of it, is built on artificial neural networks. Notice the word "neural" there. That word is meant to communicate that these artificial networks do stuff the way our brains do stuff. And indeed, if you take a few steps back, spin around 10 times, take a few shots of whiskey, and squint hard enough, there is a passing resemblance. One thing you'll probably still notice, in your drunken stupor, is that, among the thousand ways ANNs differ from brains, is that they don't use action potentials, or spikes. From the perspective of neuroscience, that can seem mighty curious. Because, for decades now, neuroscience has focused on spikes as the things that make our cognition tick.

We count them and compare them in different conditions, and generally put a lot of stock in their usefulness in brains.

So what does it mean that modern neural networks disregard spiking altogether?

Maybe spiking really isn't important to process and transmit information as well as our brains do. Or maybe spiking is one among many ways for intelligent systems to function well. Dan shares some of what he's learned and how he thinks about spiking and SNNs and a host of other topics.

  • Neural Reckoning Group.
  • Twitter: @neuralreckoning.
  • Related papers
    • Neural heterogeneity promotes robust learning.
    • Dynamics of specialization in neural modules under resource constraints.
    • Multimodal units fuse-then-accumulate evidence across channels.
    • Visualizing a joint future of neuroscience and neuromorphic engineering.
    • 0:00 - Intro

      3:47 - Why spiking neural networks, and a mathematical background
      13:16 - Efficiency
      17:36 - Machine learning for neuroscience
      19:38 - Why not jump ship from SNNs?
      23:35 - Hard and easy tasks
      29:20 - How brains and nets learn
      32:50 - Exploratory vs. theory-driven science
      37:32 - Static vs. dynamic
      39:06 - Heterogeneity
      46:01 - Unifying principles vs. a hodgepodge
      50:37 - Sparsity
      58:05 - Specialization and modularity
      1:00:51 - Naturalistic experiments
      1:03:41 - Projects for SNN research
      1:05:09 - The right level of abstraction
      1:07:58 - Obstacles to progress
      1:12:30 - Levels of explanation
      1:14:51 - What has AI taught neuroscience?
      1:22:06 - How has neuroscience helped AI?

      ...more
      View all episodesView all episodes
      Download on the App Store

      Brain InspiredBy Paul Middlebrooks

      • 4.8
      • 4.8
      • 4.8
      • 4.8
      • 4.8

      4.8

      134 ratings


      More shows like Brain Inspired

      View all
      Very Bad Wizards by Tamler Sommers & David Pizarro

      Very Bad Wizards

      2,674 Listeners

      Nature Podcast by Springer Nature Limited

      Nature Podcast

      759 Listeners

      The Quanta Podcast by Quanta Magazine

      The Quanta Podcast

      522 Listeners

      The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

      The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

      431 Listeners

      Philosophy For Our Times by IAI

      Philosophy For Our Times

      316 Listeners

      Future of Life Institute Podcast by Future of Life Institute

      Future of Life Institute Podcast

      107 Listeners

      The Good Fight by Yascha Mounk

      The Good Fight

      900 Listeners

      The Michael Shermer Show by Michael Shermer

      The Michael Shermer Show

      931 Listeners

      Big Brains by University of Chicago Podcast Network

      Big Brains

      480 Listeners

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

      Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

      4,150 Listeners

      The Origins Podcast with Lawrence Krauss by Lawrence M. Krauss

      The Origins Podcast with Lawrence Krauss

      503 Listeners

      Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

      Machine Learning Street Talk (MLST)

      90 Listeners

      Dwarkesh Podcast by Dwarkesh Patel

      Dwarkesh Podcast

      505 Listeners

      Clearer Thinking with Spencer Greenberg by Spencer Greenberg

      Clearer Thinking with Spencer Greenberg

      139 Listeners

      The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

      The Joy of Why

      491 Listeners