
Sign up to save your podcasts
Or


Standardized tests are getting torched like marshmallows at a bonfire, and AI's top students are flunking the new final. In this episode, Emily unpacks Humanity’s Last Exam, a brutal, brain-bending test designed to humble even the cockiest language model. Forget multiple choice; we’re talking diagrams, logic puzzles, and cross-disciplinary chaos that left most AIs confidently clueless. Hear how this monster exam aims to reset the curve, why benchmark saturation is a real buzzkill, and what it says about how far AI has to go before it stops giving you medical advice with the swagger of a drunk Jeopardy contestant.
Connect with Emily Laird on LinkedIn
By Emily Laird4.6
2020 ratings
Standardized tests are getting torched like marshmallows at a bonfire, and AI's top students are flunking the new final. In this episode, Emily unpacks Humanity’s Last Exam, a brutal, brain-bending test designed to humble even the cockiest language model. Forget multiple choice; we’re talking diagrams, logic puzzles, and cross-disciplinary chaos that left most AIs confidently clueless. Hear how this monster exam aims to reset the curve, why benchmark saturation is a real buzzkill, and what it says about how far AI has to go before it stops giving you medical advice with the swagger of a drunk Jeopardy contestant.
Connect with Emily Laird on LinkedIn

11,130 Listeners

1,647 Listeners

704 Listeners

30,208 Listeners

112,105 Listeners

56,649 Listeners

10,231 Listeners

960 Listeners

205 Listeners

208 Listeners

10,026 Listeners

5,522 Listeners

92 Listeners

635 Listeners

110 Listeners