Sign up to save your podcasts
Or
Share Transformers: The Discovery That Sparked the AI Revolution
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Transformers: The Discovery That Sparked the AI Revolution
Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer.In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.
View all episodes
By Y Combinator
4.6
213213 ratings
Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer.In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.
More shows like Y Combinator Startup Podcast
View all
This Week in Startups
1,294 Listeners
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
532 Listeners
The Official SaaStr Podcast: SaaS | Founders | Investors
172 Listeners
Startups For the Rest of Us
700 Listeners
a16z Podcast
1,092 Listeners
Masters of Scale
3,984 Listeners
Dwarkesh Podcast
75 Listeners
The Startup Ideas Podcast
204 Listeners
No Priors: Artificial Intelligence | Technology | Startups
130 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
503 Listeners
AI + a16z
34 Listeners
Lightcone Podcast
22 Listeners
Training Data
39 Listeners
Uncapped with Jack Altman
39 Listeners
Cheeky Pint
43 Listeners