Deep Papers

AI Benchmark Deep Dive: Gemini 2.5 and Humanity's Last Exam


Listen Later

This week we talk about modern AI benchmarks, taking a close look at Google's recent Gemini 2.5 release and its performance on key evaluations, notably  Humanity's Last Exam (HLE). In the session we covered Gemini 2.5's architecture, its advancements in reasoning and multimodality, and its impressive context window. We also talked about how benchmarks like HLE and ARC AGI 2 help us understand the current state and future direction of AI.


Join us for the next live recording, or check out the latest AI research

Learn more about AI observability and evaluation, join the Arize AI Slack community or get the latest on LinkedIn and X.

...more
View all episodesView all episodes
Download on the App Store

Deep PapersBy Arize AI

  • 5
  • 5
  • 5
  • 5
  • 5

5

15 ratings


More shows like Deep Papers

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,105 Listeners

Profile by BBC Radio 4

Profile

109 Listeners

The Quanta Podcast by Quanta Magazine

The Quanta Podcast

548 Listeners

Into the Impossible With Brian Keating by Big Bang Productions Inc.

Into the Impossible With Brian Keating

1,069 Listeners

The Daily by The New York Times

The Daily

112,161 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

226 Listeners

Physics World Weekly Podcast by Physics World

Physics World Weekly Podcast

76 Listeners

The Journal. by The Wall Street Journal & Spotify Studios

The Journal.

6,084 Listeners

Google DeepMind: The Podcast by Hannah Fry

Google DeepMind: The Podcast

198 Listeners

Americast by BBC News

Americast

735 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,187 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

97 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

564 Listeners

Hard Fork by The New York Times

Hard Fork

5,539 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

99 Listeners