Brain Inspired

Brain Inspired

Download on the App Store

Brain Inspired episodes

  • BI 010 Adam Marblestone: Brain Cost Functions

     

    Mentioned in the show
    • Adam’s Website.
    • Follow him on Twitter.
    • He made Technology Review’s 35 Innovators Under 35.
    • The paper we discuss:
      • Toward an Integration of DeepLearning and Neuroscience
      • Some of the peripheral things we discussed:
        • Cortical microcircuits: here’s an example paper.
        • Autoencoders are unsupervised learning methods to reconstruct their input.
        • A nice introduction to Generative Adversarial Networks.
        • Marvin Minsky’s classic Society of Mind.
        • Some of his talks online:
          • A Billion-Year-Old Information Technology.
          • What sets the exponent of neuroscience progress?
            1 hr 5 min
          • BI 009 Blake Richards: Deep Learning in the Brain
            Mentioned in the show
            Follow Blake on twitter: @tyrell_turing
            Blake’s Learning in Neural Circuits (LiNC) Laboratory.
            He’s a Fellow with the Learning in Machines and Brains Program of the Canadian Institute for Advanced Research (CIFAR).
            The paper we discuss:
            Towards Deep Learning With Segregated Dendrites.
            Code to run the model on Github.
            If you’d rather watch a talk, here’s the same topic in a great talk by Blake.
            The idea of approaching neuroscience from the perspective there are general principles of computation applicable to both brains and AI:
            Geoffrey Hinton.
            Cybernetics.
            McCullough and Pitts artificial neuron: Their original paper and a nice tutorial.
            Frank Rosenblaut.
            Demis Hassabis, who founded Deepmind, wrote a great review of how AI and neuroscience can work together.
            Donald Hebb of the famed Hebbian Learning in his famous book The Organization of Behavior: A Neuropsychological Theory.
            Konrad Kording’s 2001 paper articulating the same idea we discuss: Supervised and Unsupervised Learning with Two Sites of Synaptic Integration.
            MNIST dataset of handwritten digits – used to train and test a lot of machine learning networks.
            Eliminative Materialism, the idea our common sense conception of the mind is false.
            1 hr 11 min
          • BI 009 Blake Richards: Deep Learning in the Brain

            Mentioned in the show

            • Follow Blake on twitter: @tyrell_turing
            • Blake’s Learning in Neural Circuits (LiNC) Laboratory.
            • He’s a Fellow with the Learning in Machines and Brains Program of the Canadian Institute for Advanced Research (CIFAR).
            • The paper we discuss:
              • Towards Deep Learning With Segregated Dendrites.
              • Code to run the model on Github.
              • If you’d rather watch a talk, here’s the same topic in a great talk by Blake.
              • The idea of approaching neuroscience from the perspective there are general principles of computation applicable to both brains and AI:
                • Geoffrey Hinton.
                • Cybernetics.
                • McCullough and Pitts artificial neuron: Their original paper and a nice tutorial.
                • Frank Rosenblaut.
                • Demis Hassabis, who founded Deepmind, wrote a great review of how AI and neuroscience can work together.
                • Donald Hebb of the famed Hebbian Learning in his famous book The Organization of Behavior: A Neuropsychological Theory.
                • Konrad Kording’s 2001 paper articulating the same idea we discuss: Supervised and Unsupervised Learning with Two Sites of Synaptic Integration.
                • MNIST dataset of handwritten digits – used to train and test a lot of machine learning networks.
                • Eliminative Materialism, the idea our common sense conception of the mind is false.
                  1 hr 11 min
                • BI 007 Daniel Yamins: Infant AI and CNNs
                  Mentioned in the show:
                  Dan’s Stanford Neuroscience and Artificial Intelligence Laboratory:
                  The 2 papers we discuss
                  Performance-optimized hierarchical models predict neural responses in higher visual cortex
                  Learning to Play with Intrinsically-Motivated Self-Aware Agents
                  ImageNet as one of the most important things to stimulate research in AI, developed by these folks.
                  Ventral visual stream (as opposed to the Dorsal stream).
                  Retinotopy
                  Convolutional neural networks were inspired by Kunihiko Fukushima’s Neocognitron
                  2 modern of approaches to solve the ImageNet database:
                  Google’s NASNet architecture, with about 12 layers
                  Microsoft’s super deep ResNet.
                  Object permanence and some video examples
                  The distinction between the intrinsic motivation of Dan and colleagues’ AI agent and the reinforcement learning motivation of the OpenAI 5 team
                  1 hr 2 min
                • BI 007 Daniel Yamins: Infant AI and CNNs

                  Mentioned in the show:

                  • Dan’s Stanford Neuroscience and Artificial Intelligence Laboratory:
                  • The 2 papers we discuss
                    • Performance-optimized hierarchical models predict neural responses in higher visual cortex
                    • Learning to Play with Intrinsically-Motivated Self-Aware Agents
                    • ImageNet as one of the most important things to stimulate research in AI, developed by these folks.
                    • Ventral visual stream (as opposed to the Dorsal stream).
                    • Retinotopy
                    • Convolutional neural networks were inspired by Kunihiko Fukushima’s Neocognitron
                    • 2 modern of approaches to solve the ImageNet database:
                      • Google’s NASNet architecture, with about 12 layers
                      • Microsoft’s super deep ResNet.
                      • Object permanence and some video examples
                      • The distinction between the intrinsic motivation of Dan and colleagues’ AI agent and the reinforcement learning motivation of the OpenAI 5 team
                        1 hr 2 min
                      • BI 006 Ryan Poplin: Deep Solutions
                        Check out episode 6 of the Brain Inspired podcast: Deep learning, eyeballs, and brainsClick To Tweet
                        Mentioned in the show
                        Ryan Poplin
                        What is a convolutional neural network?
                        Here’s a good summary. Here’s another good summary.
                        Deep learning on eye images: CV risk factors can be predicted from retinal fundus images
                        DeepVariant: Deep learning on genomics
                        The paper: Creating a universal SNP and small indel variant caller with deep neural networks
                        A nice, less technical summary of the work
                        The code on Github
                         
                        38 min
                      • BI 006 Ryan Poplin: Deep Solutions
                        [bctt tweet=”Check out episode 6 of the Brain Inspired podcast: Deep learning, eyeballs, and brains” username=”pgmid”]

                        Mentioned in the show

                        • Ryan Poplin
                        • What is a convolutional neural network?
                          • Here’s a good summary. Here’s another good summary.
                          • Deep learning on eye images: CV risk factors can be predicted from retinal fundus images
                          • DeepVariant: Deep learning on genomics
                            • The paper: Creating a universal SNP and small indel variant caller with deep neural networks
                            • A nice, less technical summary of the work
                            • The code on Github
                            •  

                              38 min
                            • BI 005 David Sussillo: RNNs are Back!
                              David and I cover recurrent neural networks (RNNs), his work using RNNs to study motor brain processes, how dynamical systems theory is a useful approach to brains and AI, and more. Click the episode for the show notes.
                              46 min

                            About Brain Inspired

                            From the publisher's feed

                            Neuroscience and artificial intelligence work better together. Brain inspired is a celebration and exploration of the ideas driving our progress to understand intelligence. I interview experts about…

                            More shows like Brain Inspired

                            Very Bad Wizards by Tamler Sommers & David Pizarro

                            Very Bad Wizards

                            2,674 Listeners

                            Making Sense with Sam Harris by Sam Harris

                            Making Sense with Sam Harris

                            26,245 Listeners

                            Conversations with Tyler by Mercatus Center at George Mason University

                            Conversations with Tyler

                            2,450 Listeners

                            The Quanta Podcast by Quanta Magazine

                            The Quanta Podcast

                            542 Listeners

                            Closer To Truth by Closer To Truth

                            Closer To Truth

                            243 Listeners

                            The Michael Shermer Show by Michael Shermer

                            The Michael Shermer Show

                            938 Listeners

                            Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll

                            Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

                            4,163 Listeners

                            The Origins Podcast with Lawrence Krauss by Lawrence M. Krauss

                            The Origins Podcast with Lawrence Krauss

                            507 Listeners

                            Google DeepMind: The Podcast by Hannah Fry

                            Google DeepMind: The Podcast

                            204 Listeners

                            Last Week in AI by Skynet Today

                            Last Week in AI

                            316 Listeners

                            Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

                            Machine Learning Street Talk (MLST)

                            98 Listeners

                            Dwarkesh Podcast by Dwarkesh Patel

                            Dwarkesh Podcast

                            567 Listeners

                            Theories of Everything with Curt Jaimungal by Theories of Everything

                            Theories of Everything with Curt Jaimungal

                            18 Listeners

                            Clearer Thinking with Spencer Greenberg by Spencer Greenberg

                            Clearer Thinking with Spencer Greenberg

                            137 Listeners

                            Robinson's Podcast by Robinson Erhardt

                            Robinson's Podcast

                            270 Listeners