Weird Things

The AI Frontier: Hitting Walls and Vaulting Over Them


Listen Later

The episode opens with a discussion of rapid recent AI releases and whether AI has "hit a wall." Andrew points to OpenAI's O3 and Google video models as evidence that capabilities are still advancing, while Justin uses the ARC Prize and AGI as the lens for asking how quickly systems are improving and whether a reasonable AGI label could arrive within the next year. Andrew's response emphasizes the "jagged frontier": models can be very strong on some tasks and weak on others, so benchmark gains do not translate cleanly into broad intelligence. A major middle section focuses on DeepSeek, which the hosts describe as a highly capable Chinese model that has excited open-source enthusiasts and alarmed frontier-lab skeptics. Andrew argues the model should be understood in context: export restrictions may have pushed efficiency work, but the model likely also benefited from distilled outputs from frontier models and other structured training data, so it is not a clean from-scratch achievement. The episode then turns to YouTube's AI-training opt-in controls, the copyright and compensation questions around creator data, the growing reputational stigma around obvious AI-generated creative work, and predictions for 2025 that include more AI-automated workflows, a company announcing AGI, and more AI-assisted email handling. Key topics AI benchmark gains and the "hitting a wall" narrative: The hosts contrast media claims that AI has stalled with examples of large benchmark jumps, especiall
...more
View all episodesView all episodes
Download on the App Store

Weird ThingsBy Andrew Mayne

  • 4.5
  • 4.5
  • 4.5
  • 4.5
  • 4.5

4.5

329 ratings


More shows like Weird Things

View all
Wait Wait... Don't Tell Me! by NPR

Wait Wait... Don't Tell Me!

38,950 Listeners

Stuff To Blow Your Mind by iHeartPodcasts

Stuff To Blow Your Mind

5,667 Listeners

Fat Man Beyond by SModcast Network

Fat Man Beyond

3,930 Listeners

Big Picture Science by Big Picture Science

Big Picture Science

945 Listeners

Film Sack by Scott Johnson

Film Sack

1,377 Listeners

This Week in Tech (Audio) by TWiT

This Week in Tech (Audio)

3,059 Listeners

MacBreak Weekly (Audio) by TWiT

MacBreak Weekly (Audio)

2,013 Listeners

Our Fake History by PodcastOne

Our Fake History

3,482 Listeners

Stuff They Don't Want You To Know by iHeartPodcasts

Stuff They Don't Want You To Know

10,365 Listeners

Ridiculous History by iHeartPodcasts

Ridiculous History

4,561 Listeners

Dan Carlin's Hardcore History: Addendum by Dan Carlin

Dan Carlin's Hardcore History: Addendum

8,312 Listeners

The Michael Shermer Show by Michael Shermer

The Michael Shermer Show

941 Listeners

The Political Orphanage by Andrew Heaton

The Political Orphanage

982 Listeners

How We Survive by Marketplace

How We Survive

1,377 Listeners

OpenAI Podcast by OpenAI

OpenAI Podcast

59 Listeners