Sign up to save your podcasts
Or
Share #94 – Ilya Sutskever: Deep Learning
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
#94 – Ilya Sutskever: Deep Learning
Ilya Sutskever is the co-founder of OpenAI, is one of the most cited computer scientist in history with over 165,000 citations, and to me, is one of the most brilliant and insightful minds ever in the field of deep learning. There are very few people in this world who I would rather talk to and brainstorm with about deep learning, intelligence, and life than Ilya, on and off the mic.
Support this podcast by signing up with these sponsors:
– Cash App – use code “LexPodcast” and download:
– Cash App (App Store): https://apple.co/2sPrUHe
– Cash App (Google Play): https://bit.ly/2MlvP5w
EPISODE LINKS:
Ilya’s Twitter: https://twitter.com/ilyasut
Ilya’s Website: https://www.cs.toronto.edu/~ilya/
This conversation is part of the Artificial Intelligence podcast. If you would like to get more information about this podcast go to https://lexfridman.com/ai or connect with @lexfridman on Twitter, LinkedIn, Facebook, Medium, or YouTube where you can watch the video versions of these conversations. If you enjoy the podcast, please rate it 5 stars on Apple Podcasts, follow on Spotify, or support it on Patreon.
Here’s the outline of the episode. On some podcast players you should be able to click the timestamp to jump to that time.
OUTLINE:
00:00 – Introduction
02:23 – AlexNet paper and the ImageNet moment
08:33 – Cost functions
13:39 – Recurrent neural networks
16:19 – Key ideas that led to success of deep learning
19:57 – What’s harder to solve: language or vision?
29:35 – We’re massively underestimating deep learning
36:04 – Deep double descent
41:20 – Backpropagation
42:42 – Can neural networks be made to reason?
50:35 – Long-term memory
56:37 – Language models
1:00:35 – GPT-2
1:07:14 – Active learning
1:08:52 – Staged release of AI systems
1:13:41 – How to build AGI?
1:25:00 – Question to AGI
1:32:07 – Meaning of life
View all episodes
By Lex Fridman
4.7
1197811,978 ratings
Ilya Sutskever is the co-founder of OpenAI, is one of the most cited computer scientist in history with over 165,000 citations, and to me, is one of the most brilliant and insightful minds ever in the field of deep learning. There are very few people in this world who I would rather talk to and brainstorm with about deep learning, intelligence, and life than Ilya, on and off the mic.
Support this podcast by signing up with these sponsors:
– Cash App – use code “LexPodcast” and download:
– Cash App (App Store): https://apple.co/2sPrUHe
– Cash App (Google Play): https://bit.ly/2MlvP5w
EPISODE LINKS:
Ilya’s Twitter: https://twitter.com/ilyasut
Ilya’s Website: https://www.cs.toronto.edu/~ilya/
This conversation is part of the Artificial Intelligence podcast. If you would like to get more information about this podcast go to https://lexfridman.com/ai or connect with @lexfridman on Twitter, LinkedIn, Facebook, Medium, or YouTube where you can watch the video versions of these conversations. If you enjoy the podcast, please rate it 5 stars on Apple Podcasts, follow on Spotify, or support it on Patreon.
Here’s the outline of the episode. On some podcast players you should be able to click the timestamp to jump to that time.
OUTLINE:
00:00 – Introduction
02:23 – AlexNet paper and the ImageNet moment
08:33 – Cost functions
13:39 – Recurrent neural networks
16:19 – Key ideas that led to success of deep learning
19:57 – What’s harder to solve: language or vision?
29:35 – We’re massively underestimating deep learning
36:04 – Deep double descent
41:20 – Backpropagation
42:42 – Can neural networks be made to reason?
50:35 – Long-term memory
56:37 – Language models
1:00:35 – GPT-2
1:07:14 – Active learning
1:08:52 – Staged release of AI systems
1:13:41 – How to build AGI?
1:25:00 – Question to AGI
1:32:07 – Meaning of life
More shows like Lex Fridman Podcast
View all
The Joe Rogan Experience
229,051 Listeners
Making Sense with Sam Harris
26,364 Listeners
Conversations with Tyler
2,438 Listeners
a16z Podcast
1,095 Listeners
Into the Impossible With Brian Keating
1,062 Listeners
The Jordan B. Peterson Podcast
33,303 Listeners
Modern Wisdom
3,861 Listeners
Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas
4,153 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
9,909 Listeners
Dwarkesh Podcast
70 Listeners
Theories of Everything with Curt Jaimungal
34 Listeners
Huberman Lab
29,194 Listeners
Joe Lonsdale: American Optimist
165 Listeners
The Ben & Marc Show
118 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
521 Listeners