EPRI Current

71. Beyond the Benchmark: Evaluating AI for Real‑World Use


Listen Later

How should organizations interpret AI benchmarks – and where do they fall short when moving from pilots to real‑world deployment?
 
 
In this episode of EPRI Current, host Samantha Gilman is joined by Jaime Sevilla, Director of Epoch AI, and Apurba Sakti, EPRI Principal Technical Leader for AI, for a deep dive into AI benchmarking and responsible adoption. The conversation explores why strong benchmark scores don’t always translate into operational readiness, the limitations of generic leaderboards, and why domain‑ and workflow-specific evaluations are critical – especially in high-consequence sectors like energy. The discussion highlights how organizations can move beyond demonstrations toward continuous, evidence‑based evaluation to ensure AI systems are reliable, transparent, and fit for real‑world use.
 
 
 
For more information and episodes visit EPRI.com.
 

 

If you enjoy this podcast, please subscribe and share! And please consider leaving a review and rating on Apple Podcasts/iTunes. 

 

Follow EPRI:

LinkedIn https://www.linkedin.com/company/epri/ 

Twitter https://twitter.com/EPRINews 

 

EPRI Current examines key issues and new R&D impacting the energy transition. Each episode features insights from EPRI, the world's preeminent independent, non-profit energy research and development organization, and from other energy industry leaders. We also discuss how innovative technologies are shaping the global energy future. Learn more at www.epri.com 

...more
View all episodesView all episodes
Download on the App Store

EPRI CurrentBy EPRI

  • 5
  • 5
  • 5
  • 5
  • 5

5

4 ratings


More shows like EPRI Current

View all
The Joe Rogan Experience by Joe Rogan

The Joe Rogan Experience

229,674 Listeners

The Tim Ferriss Show by Tim Ferriss: Bestselling Author, Human Guinea Pig

The Tim Ferriss Show

16,174 Listeners

Marketplace by Marketplace

Marketplace

8,801 Listeners

Exchanges by Goldman Sachs

Exchanges

977 Listeners

Notes on the Week Ahead by Dr. David Kelly

Notes on the Week Ahead

199 Listeners

Insights Now by Dr. David Kelly and Gabriela Santos, J.P. Morgan Asset Management

Insights Now

96 Listeners

The Daily by The New York Times

The Daily

113,121 Listeners

The Peter Attia Drive by Peter Attia, MD

The Peter Attia Drive

8,043 Listeners

FT News Briefing by Financial Times

FT News Briefing

684 Listeners

Grid Talk by DOE|Advanced Grid Research

Grid Talk

22 Listeners

Huberman Lab by Scicomm Media

Huberman Lab

29,272 Listeners

The Markets by Goldman Sachs

The Markets

80 Listeners

The Tucker Carlson Show by Tucker Carlson Network

The Tucker Carlson Show

16,982 Listeners