Back in late 2022, Alona Fyshe was working on a TED Talk about how we evaluate the performance of Large Language Models. Little did she know, there was something big on the horizon.

In this episode, Alona tells co-host Scott Lilwall about how the release of ChatGPT shook the field of Natural Language Processing (and made her rethink her entire talk.)It’s a story about how we test machine learning models and a tremendous shift in the public’s expectations of what AI can do.

You can see the final version of Alona’s talk here: https://www.ted.com/talks/alona_fyshe_does_ai_actually_understand_us

Production Credits: Lynda Vang, Keely Booth - Producer, Chris Onciul - Video Production, Jen Tomski - Social Media

Music Credits: Main Theme - Brooklyn Bridge by Lunareh