Tech Talks Daily

3288: MLPerf vs Moore's Law: Redefining AI Progress


Listen Later

What happens when the world's most powerful AI systems are measured by the same yardstick?

In this episode of Tech Talks Daily, I spoke with David Kanter, Founder and Executive Director of MLCommons, the organization behind MLPerf, the industry's most recognized benchmark for AI performance. As AI continues to outpace Moore's Law, businesses and governments alike are asking the same question: how do we know what "good" AI performance really looks like? That's exactly the challenge MLCommons set out to address.

David shares the story of how a simple suggestion at a Stanford meeting led him from analyst to the architect of a global benchmarking initiative. He explains how MLPerf benchmarks are helping enterprises and policymakers make informed decisions about AI systems, and why transparency, neutrality, and open collaboration are central to the mission.

We explore what's really driving AI's explosive growth. It's not just about chips. Smarter software, algorithmic breakthroughs, and increasingly scalable system designs are all contributing to performance improvements far beyond what Moore's Law predicted.

But AI's rapid progress comes with a cost. Power consumption is quickly becoming one of the biggest challenges in the industry. David explains how MLCommons is helping address this with MLPerf Power and why infrastructure innovations like low-precision computation, advanced cooling, and even proximity to power generation are gaining traction.

We also talk about the decision by some major vendors not to participate in MLPerf. David offers perspective on what that means for buyers and why benchmark transparency should be part of any enterprise AI procurement conversation.

Beyond the data center, MLCommons is now benchmarking AI performance on consumer hardware through MLPerf Client and is working on domain-specific efforts such as MLPerf Automotive. As AI shows up in smartphones, vehicles, and smart devices, the need for clear, fair, and relevant performance measurement is only growing.

So how do we measure AI that is everywhere? What should buyers demand from vendors? And how can the industry ensure that AI systems are fast, efficient, and accountable? Let's find out.

...more
View all episodesView all episodes
Download on the App Store

Tech Talks DailyBy Neil C. Hughes

  • 5
  • 5
  • 5
  • 5
  • 5

5

198 ratings


More shows like Tech Talks Daily

View all
This Week in Startups by Jason Calacanis

This Week in Startups

1,287 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

537 Listeners

WSJ Tech News Briefing by The Wall Street Journal

WSJ Tech News Briefing

1,640 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,090 Listeners

HBR IdeaCast by Harvard Business Review

HBR IdeaCast

164 Listeners

Gartner ThinkCast by Gartner

Gartner ThinkCast

111 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

303 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

334 Listeners

DataFramed by DataCamp

DataFramed

269 Listeners

Practical AI by Practical AI LLC

Practical AI

207 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,920 Listeners

Hard Fork by The New York Times

Hard Fork

5,509 Listeners

Business Breakdowns by Colossus | Investing & Business Podcasts

Business Breakdowns

349 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

93 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

608 Listeners

Consulting the Future by Neil C. Hughes

Consulting the Future

0 Listeners

Startup Builders & Backers by Neil C. Hughes

Startup Builders & Backers

0 Listeners

IT Infrastructure as a Conversation by Neil C. Hughes

IT Infrastructure as a Conversation

0 Listeners

AI at Work by Neil C. Hughes

AI at Work

0 Listeners

The Business of Cybersecurity by Neil C. Hughes

The Business of Cybersecurity

0 Listeners

Business Technology Perspectives by Neil Hughes

Business Technology Perspectives

0 Listeners

Conversations from the Show Floor by Neil C. Hughes

Conversations from the Show Floor

0 Listeners