Raw Data with Rob Collie

Why Bigger AI Isn't Always Better


Listen Later

Microsoft just unveiled a monster of a machine built for local AI. More memory. More horsepower. More everything.

Which led Rob and Justin to a question that has almost nothing to do with the hardware.

Are we already using more AI than the job actually requires?

This conversation starts with Microsoft's latest announcement but quickly turns into something much bigger. When do you actually need a frontier model? When is a smaller model just as good? And what happens when companies stop optimizing for the smartest AI and start optimizing for the right AI?

It's a familiar pattern. New technology shows up, everyone assumes bigger is better, and eventually we learn that the best solution isn't the most powerful one. It's the one that's powerful enough. AI may be reaching that point faster than anyone expected.

Along the way, Rob and Justin dig into the economics of tokens, why developers should think differently than everyday AI users, and why Microsoft's latest hardware announcement feels like it's missing a piece of the story. They don't pretend to have all the answers. Instead, they do what this podcast does best: pull on an interesting thread until a much better conversation emerges.

If your first instinct has been to reach for the biggest model every time, this episode might convince you that the future belongs to the people who know when not to.

...more
View all episodesView all episodes
Download on the App Store

Raw Data with Rob CollieBy P3 Adaptive

  • 5
  • 5
  • 5
  • 5
  • 5

5

53 ratings


More shows like Raw Data with Rob Collie

View all
The Joe Rogan Experience by Joe Rogan

The Joe Rogan Experience

228,364 Listeners

Planet Money by NPR

Planet Money

30,681 Listeners

More or Less by BBC Radio 4

More or Less

879 Listeners

Money Guy Show by Brian Preston and Bo Hanson

Money Guy Show

3,252 Listeners

The McKinsey Podcast by McKinsey & Company

The McKinsey Podcast

408 Listeners

Pivot by New York Magazine

Pivot

9,633 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

300 Listeners

Data Engineering Podcast by Tobias Macey

Data Engineering Podcast

144 Listeners

The Indicator from Planet Money by NPR

The Indicator from Planet Money

9,531 Listeners

The Journal. by The Wall Street Journal & Spotify Studios

The Journal.

6,088 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,196 Listeners

Deep Questions with Cal Newport by Cal Newport

Deep Questions with Cal Newport

1,345 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,023 Listeners

Explicit Measures Podcast by PowerBI.Tips

Explicit Measures Podcast

32 Listeners

Explicit Measures Podcast by PowerBI.Tips

Explicit Measures Podcast

10 Listeners