
Sign up to save your podcasts
Or


Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer.In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.
By Y Combinator4.6
215215 ratings
Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer.In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.

1,296 Listeners

536 Listeners

1,105 Listeners

2,221 Listeners

341 Listeners

212 Listeners

551 Listeners

300 Listeners

211 Listeners

150 Listeners

101 Listeners

475 Listeners

34 Listeners

21 Listeners

42 Listeners