Sign up to save your podcasts
Or
Share Transformers: The Discovery That Sparked the AI Revolution
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Transformers: The Discovery That Sparked the AI Revolution
Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer.In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.
View all episodes
By Y Combinator
4.6
214214 ratings
Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer.In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.
More shows like Y Combinator Startup Podcast
View all
This Week in Startups
1,286 Listeners
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
535 Listeners
The Official SaaStr Podcast: SaaS | Founders | Investors
176 Listeners
Startups For the Rest of Us
703 Listeners
a16z Podcast
1,092 Listeners
Masters of Scale
3,986 Listeners
Dwarkesh Podcast
504 Listeners
The Startup Ideas Podcast
208 Listeners
No Priors: Artificial Intelligence | Technology | Startups
135 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
516 Listeners
AI + a16z
35 Listeners
Lightcone Podcast
22 Listeners
Training Data
38 Listeners
Uncapped with Jack Altman
40 Listeners
Cheeky Pint
51 Listeners