Sign up to save your podcasts
Or
Share “Varieties Of Doom” by jdp
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
“Varieties Of Doom” by jdp
There has been a lot of talk about "p(doom)"
over the last few years. This has always rubbed me the wrong way
because "p(doom)" didn't feel like it mapped to any specific belief in my head.
In private conversations I'd sometimes give my p(doom) as 12%, with the caveat
that "doom" seemed nebulous and conflated between several different concepts.
At some point it was decided
a p(doom) over 10% makes you a "doomer" because it means what actions you should take with respect to
AI are overdetermined. I did not and do not feel that is true. But any time I
felt prompted to explain my position I'd find I could explain a little bit of
this or that, but not really convey the whole thing. As it turns out doom has
a lot of parts, and every part is entangled with every other part so no matter
which part you explain you always feel like you're leaving the crucial parts out. Doom is
more like an onion than a
single event, a distribution over AI outcomes people frequently
respond to with the force of the fear of death. Some of these outcomes are less
than death and some [...]
---
Outline:
(03:46) 1. Existential Ennui
(06:40) 2. Not Getting Immortalist Luxury Gay Space Communism
(13:55) 3. Human Stock Expended As Cannon Fodder Faster Than Replacement
(19:37) 4. Wiped Out By AI Successor Species
(27:57) 5. The Paperclipper
(42:56) Would AI Successors Be Conscious Beings?
(44:58) Would AI Successors Care About Each Other?
(49:51) Would AI Successors Want To Have Fun?
(51:11) VNM Utility And Human Values
(55:57) Would AI successors get bored?
(01:00:16) Would AI Successors Avoid Wireheading?
(01:06:07) Would AI Successors Do Continual Active Learning?
(01:06:35) Would AI Successors Have The Subjective Experience of Will?
(01:12:00) Multiply
(01:15:07) 6. Recipes For Ruin
(01:18:02) Radiological and Nuclear
(01:19:19) Cybersecurity
(01:23:00) Biotech and Nanotech
(01:26:35) 7. Large-Finite Damnation
---
First published:
November 17th, 2025
Source:
https://www.lesswrong.com/posts/apHWSGDiydv3ivmg6/varieties-of-doom
---
Narrated by TYPE III AUDIO.
---
Images from the article:
Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
View all episodes
By LessWrongThere has been a lot of talk about "p(doom)"
over the last few years. This has always rubbed me the wrong way
because "p(doom)" didn't feel like it mapped to any specific belief in my head.
In private conversations I'd sometimes give my p(doom) as 12%, with the caveat
that "doom" seemed nebulous and conflated between several different concepts.
At some point it was decided
a p(doom) over 10% makes you a "doomer" because it means what actions you should take with respect to
AI are overdetermined. I did not and do not feel that is true. But any time I
felt prompted to explain my position I'd find I could explain a little bit of
this or that, but not really convey the whole thing. As it turns out doom has
a lot of parts, and every part is entangled with every other part so no matter
which part you explain you always feel like you're leaving the crucial parts out. Doom is
more like an onion than a
single event, a distribution over AI outcomes people frequently
respond to with the force of the fear of death. Some of these outcomes are less
than death and some [...]
---
Outline:
(03:46) 1. Existential Ennui
(06:40) 2. Not Getting Immortalist Luxury Gay Space Communism
(13:55) 3. Human Stock Expended As Cannon Fodder Faster Than Replacement
(19:37) 4. Wiped Out By AI Successor Species
(27:57) 5. The Paperclipper
(42:56) Would AI Successors Be Conscious Beings?
(44:58) Would AI Successors Care About Each Other?
(49:51) Would AI Successors Want To Have Fun?
(51:11) VNM Utility And Human Values
(55:57) Would AI successors get bored?
(01:00:16) Would AI Successors Avoid Wireheading?
(01:06:07) Would AI Successors Do Continual Active Learning?
(01:06:35) Would AI Successors Have The Subjective Experience of Will?
(01:12:00) Multiply
(01:15:07) 6. Recipes For Ruin
(01:18:02) Radiological and Nuclear
(01:19:19) Cybersecurity
(01:23:00) Biotech and Nanotech
(01:26:35) 7. Large-Finite Damnation
---
First published:
November 17th, 2025
Source:
https://www.lesswrong.com/posts/apHWSGDiydv3ivmg6/varieties-of-doom
---
Narrated by TYPE III AUDIO.
---
Images from the article:
Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
More shows like LessWrong (30+ Karma)
View all
The Daily
112,956 Listeners
Astral Codex Ten Podcast
132 Listeners
Interesting Times with Ross Douthat
7,290 Listeners
Dwarkesh Podcast
548 Listeners
The Ezra Klein Show
16,362 Listeners
AI Article Readings
4 Listeners
Doom Debates
14 Listeners
LessWrong posts by zvi
2 Listeners