Sign up to save your podcasts
Or
Share Transformers: The Discovery That Sparked the AI Revolution
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Transformers: The Discovery That Sparked the AI Revolution
Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer.In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.
View all episodes
By Y Combinator
4.6
214214 ratings
Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer.In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.
More shows like Y Combinator Startup Podcast
View all
This Week in Startups
1,284 Listeners
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
530 Listeners
The Official SaaStr Podcast: SaaS | Founders | Investors
177 Listeners
Startups For the Rest of Us
704 Listeners
The a16z Show
1,095 Listeners
Masters of Scale
3,988 Listeners
Dwarkesh Podcast
517 Listeners
The Startup Ideas Podcast
203 Listeners
No Priors: Artificial Intelligence | Technology | Startups
130 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
472 Listeners
AI + a16z
36 Listeners
Lightcone Podcast
22 Listeners
Training Data
40 Listeners
Uncapped with Jack Altman
43 Listeners
Cheeky Pint
36 Listeners