LessWrong posts by zvi

“AI #173: AI Pauses” by Zvi


Listen Later

A lot of things are always happening. Only one story matters.

Claude Fable 5 and Claude Mythos 5 were shut down, by the White House, via an imposition of export controls at 5:23pm on Friday, wreaking all sorts of havoc.

There was then a scramble. Anthropic flew its people out to Washington, where they met with the Trump Administration on Monday, with hopes expressed that this could be quickly resolved.

What caused this? The Trump Administration said it was due to a jailbreak of Fable, which we now know they were told about by Amazon. They called Dario Amodei, who they complain did not take the issue sufficiently seriously. Rather than shutting down the model, he tried to explain why he saw no need to do that. This did not go well.

The ‘jailbreak’ turns out to be saying ‘fix this code,’ and the demo was getting Fable to find the same weaknesses that were easily identified by Opus 4.8 and GPT-5.5. As in, Fable is willing to work to fix security vulnerabilities if you give it a codebase. From this information and process, you could then figure out what the original bug in the [...]

---

Outline:

(02:40) Language Models Offer Mundane Utility

(02:51) Language Models Don't Offer Mundane Utility

(03:14) Huh, Upgrades

(03:44) On Your Marks

(08:43) VirtueBench

(10:40) Choose Your Fighter

(11:20) Papers, Please

(11:48) Deepfaketown and Botpocalypse Soon

(13:32) Goodhart's Law Strikes Again

(14:23) They Took Our Jobs

(16:49) The MidJourney Full Body Imaging Scanner

(19:16) Introducing

(20:36) In Other AI News

(22:47) Show Me the Money

(23:18) Bubble, Bubble, Toil and Trouble

(24:51) Quiet Speculations

(27:15) People Just Say Things

(30:30) The Widened Path

(32:34) Scott Alexander Lays Out His AI Opinions

(38:36) Quickly, There's No Time

(39:50) Policy On The AI Exponential

(49:36) Anthropic Offers Two Policy Frameworks

(50:46) Obligations of Developers

(55:11) Societal Resilience Measures

(56:20) Economic Policy Framework

(01:01:26) White House Pauses AI Deployment

(01:10:14) The Once And Future Fable

(01:15:29) How To Fix This Code

(01:17:14) The End of Privacy

(01:18:45) AIs Have Preferences

(01:20:56) The Quest for Sane Regulations

(01:23:37) Chip City

(01:24:14) The Week in Audio

(01:24:25) Rhetorical Innovation

(01:25:03) Aligning a Smarter Than Human Intelligence is Difficult

(01:26:40) People Are Worried About AI Killing Everyone

(01:27:53) The Lighter Side

The original text contained 2 footnotes which were omitted from this narration.

---

First published:

June 18th, 2026

Source:

https://www.lesswrong.com/posts/P7jBmCeBDq2ebojWY/ai-173-ai-pauses

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

...more
View all episodesView all episodes
Download on the App Store

LessWrong posts by zviBy zvi

  • 5
  • 5
  • 5
  • 5
  • 5

5

2 ratings


More shows like LessWrong posts by zvi

View all
Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,254 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,448 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,096 Listeners

Future of Life Institute Podcast by Future of Life Institute

Future of Life Institute Podcast

107 Listeners

ChinaTalk by Jordan Schneider

ChinaTalk

292 Listeners

Politix by Politix

Politix

90 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

577 Listeners

Hard Fork by The New York Times

Hard Fork

5,533 Listeners

Clearer Thinking with Spencer Greenberg by Spencer Greenberg

Clearer Thinking with Spencer Greenberg

138 Listeners

LessWrong (Curated & Popular) by LessWrong

LessWrong (Curated & Popular)

12 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

143 Listeners

"Econ 102" with Noah Smith and Erik Torenberg by Turpentine

"Econ 102" with Noah Smith and Erik Torenberg

146 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

489 Listeners

LessWrong (30+ Karma) by LessWrong

LessWrong (30+ Karma)

0 Listeners

Complex Systems with Patrick McKenzie (patio11) by Patrick McKenzie

Complex Systems with Patrick McKenzie (patio11)

142 Listeners