
Sign up to save your podcasts
Or
And then we hit a wall.
Nobody expected it. Well... almost nobody. Yann LeCun posted his "I told you so's" all over X. Gary Marcus insisted he'd predicted this all along. Sam Altman pivoted, declaring o3 was actually already ASI.
The first rumors of scaling laws breaking down were already circulating in late 2024. By late 2025, it was clear that test-time scaling was not coming to the rescue. Despite the scaling labs' best efforts, nobody could figure out how to generalize reasoning beyond the comfortable confines of formally verifiable domains. Sure, you could train reasoning models on math and a little bit on coding, but that was it — transformers had reached their limits.
Or so we thought. It turned out there was still plenty of room to explore in the high reaches of mathematics. Building on foundations laid by o1, Minerva, and AlphaProof, DeepMind's [...]
---
First published:
Source:
Narrated by TYPE III AUDIO.
And then we hit a wall.
Nobody expected it. Well... almost nobody. Yann LeCun posted his "I told you so's" all over X. Gary Marcus insisted he'd predicted this all along. Sam Altman pivoted, declaring o3 was actually already ASI.
The first rumors of scaling laws breaking down were already circulating in late 2024. By late 2025, it was clear that test-time scaling was not coming to the rescue. Despite the scaling labs' best efforts, nobody could figure out how to generalize reasoning beyond the comfortable confines of formally verifiable domains. Sure, you could train reasoning models on math and a little bit on coding, but that was it — transformers had reached their limits.
Or so we thought. It turned out there was still plenty of room to explore in the high reaches of mathematics. Building on foundations laid by o1, Minerva, and AlphaProof, DeepMind's [...]
---
First published:
Source:
Narrated by TYPE III AUDIO.
26,308 Listeners
2,404 Listeners
7,899 Listeners
4,116 Listeners
87 Listeners
1,446 Listeners
8,784 Listeners
90 Listeners
356 Listeners
5,370 Listeners
15,285 Listeners
470 Listeners
128 Listeners
73 Listeners
442 Listeners