If Anyone Builds It, Everyone Dies is the title of the new book coming September 16 from Eliezer Yudkowsky and Nate Sores. The ‘it’ in question is superintelligence built on anything like the current AI paradigm, and they very much mean this literally. I am less confident in this claim than they are, but it seems rather likely to me. If that is relevant to your interests, and it should be, please consider preordering it.

This week also featured two posts explicitly about AI policy, in the wake of the Senate hearing on AI. First, I gave a Live Look at the Senate AI Hearing, and then I responded directly to arguments about AI Diffusion rules. I totally buy that we can improve upon Biden's proposed AI diffusion rules, especially in finding something less complex and in treating some of our allies better, no one is saying we [...]

---

Outline:

(02:33) Language Models Offer Mundane Utility

(06:24) Language Models Don't Offer Mundane Utility

(06:55) Huh, Upgrades

(08:07) Gemini 2.5 Pro Gets An Ambiguous Upgrade

(15:30) GPT-4o Is Still A (Less) Absurd Sycophant

(20:17) Choose Your Fighter

(20:35) Deepfaketown and Botpocalypse Soon

(20:52) Copyright Confrontation

(26:52) Cheaters Gonna Cheat Cheat Cheat Cheat Cheat

(28:25) They Took Our Jobs

(30:16) Safety Third

(31:00) The Art of the Jailbreak

(31:09) Get Involved

(32:04) If Anyone Builds It, Everyone Dies

(34:42) Endorsements for Eliezer's Book

(37:11) Why Preorders Matter

(41:14) Great Expectations

(42:07) Introducing

(45:51) In Other AI News

(48:27) Quiet Speculations

(54:35) Four Important Charts

(56:52) Unprompted Suggestions

(01:02:11) Unprompted Suggestions For You

(01:03:06) How to Be a Good Claude

(01:04:00) The Quest for Sane Regulations

(01:14:44) The Week in Audio

(01:14:53) Rhetorical Innovation

(01:20:53) Aligning a Smarter Than Human Intelligence is Difficult

(01:21:34) Is the Pope Worried About AI

(01:22:27) People Are Worried About AI Killing Everyone

(01:23:49) The Lighter Side

---

First published:

Source:

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.