Machine Learning Street Talk (MLST)

#104 - Prof. CHRIS SUMMERFIELD - Natural General Intelligence [SPECIAL EDITION]


Listen Later

Support us! https://www.patreon.com/mlst  

MLST Discord: https://discord.gg/aNPkGUQtc5


Christopher Summerfield, Department of Experimental Psychology, University of Oxford is a Professor of Cognitive Neuroscience at the University of Oxford and a Research Scientist at Deepmind UK. His work focusses on the neural and computational mechanisms by which humans make decisions.

Chris has just released an incredible new book on AI called "Natural General Intelligence". It's my favourite book on AI I have read so so far. 

The book explores the algorithms and architectures that are driving progress in AI research, and discusses intelligence in the language of psychology and biology, using examples and analogies to be comprehensible to a wide audience. It also tackles longstanding theoretical questions about the nature of thought and knowledge.

With Chris' permission, I read out a summarised version of Chapter 2 from his book on which was on Intelligence during the 30 minute MLST introduction.  

Buy his book here:

https://global.oup.com/academic/product/natural-general-intelligence-9780192843883?cc=gb&lang=en&


YT version: https://youtu.be/31VRbxAl3t0

Interviewer: Dr. Tim Scarfe


TOC:

[00:00:00] Walk and talk with Chris on Knowledge and Abstractions

[00:04:08] Intro to Chris and his book

[00:05:55] (Intro) Tim reads Chapter 2: Intelligence 

[00:09:28] Intro continued: Goodhart's law

[00:15:37] Intro continued: The "swiss cheese" situation  

[00:20:23] Intro continued: On Human Knowledge

[00:23:37] Intro continued: Neats and Scruffies

[00:30:22] Interview kick off 

[00:31:59] What does it mean to understand?

[00:36:18] Aligning our language models

[00:40:17] Creativity 

[00:41:40] "Meta" AI and basins of attraction 

[00:51:23] What can Neuroscience impart to AI

[00:54:43] Sutton, neats and scruffies and human alignment

[01:02:05] Reward is enough

[01:19:46] Jon Von Neumann and Intelligence

[01:23:56] Compositionality


References:


The Language Game (Morten H. Christiansen, Nick Chater

https://www.penguin.co.uk/books/441689/the-language-game-by-morten-h-christiansen-and--nick-chater/9781787633483

Theory of general factor (Spearman)

https://www.proquest.com/openview/7c2c7dd23910c89e1fc401e8bb37c3d0/1?pq-origsite=gscholar&cbl=1818401

Intelligence Reframed (Howard Gardner)

https://books.google.co.uk/books?hl=en&lr=&id=Qkw4DgAAQBAJ&oi=fnd&pg=PT6&dq=howard+gardner+multiple+intelligences&ots=ERUU0u5Usq&sig=XqiDgNUIkb3K9XBq0vNbFmXWKFs#v=onepage&q=howard%20gardner%20multiple%20intelligences&f=false

The master algorithm (Pedro Domingos)

https://www.amazon.co.uk/Master-Algorithm-Ultimate-Learning-Machine/dp/0241004543

A Thousand Brains: A New Theory of Intelligence (Jeff Hawkins)

https://www.amazon.co.uk/Thousand-Brains-New-Theory-Intelligence/dp/1541675819

The bitter lesson (Rich Sutton)

http://www.incompleteideas.net/IncIdeas/BitterLesson.html

...more
View all episodesView all episodes
Download on the App Store

Machine Learning Street Talk (MLST)By Machine Learning Street Talk (MLST)

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

90 ratings


More shows like Machine Learning Street Talk (MLST)

View all
Data Skeptic by Kyle Polich

Data Skeptic

479 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,095 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

302 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

333 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

228 Listeners

Practical AI by Practical AI LLC

Practical AI

204 Listeners

ManifoldOne by Steve Hsu

ManifoldOne

95 Listeners

Google DeepMind: The Podcast by Hannah Fry

Google DeepMind: The Podcast

207 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

517 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

501 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

130 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

228 Listeners

AI + a16z by a16z

AI + a16z

36 Listeners

Training Data by Sequoia Capital

Training Data

42 Listeners

Complex Systems with Patrick McKenzie (patio11) by Patrick McKenzie

Complex Systems with Patrick McKenzie (patio11)

134 Listeners