Sign up to save your podcasts
Or
Share “AI #140: Trying To Hold The Line” by Zvi
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
“AI #140: Trying To Hold The Line” by Zvi
Sometimes the best you can do is try to avoid things getting even worse even faster.
Thus, one has to write articles such as ‘Please Do Not Sell B30A Chips to China.’
It's rather crazy to think that one would have to say this out loud.
In the same way, it seems not only do we need to say out loud to Not Build Superintelligence Right Now, there are those who say how dare you issue such a statement without knowing how to do so safety, so instead we should build superintelligence without knowing how to do so safety. The alternative is to risk societal dynamics we do not know how to control and that could have big unintended consequences, you say? Yes, well.
One good thing to come out of that was that Sriram Krishnan asked (some of) the right questions, giving us the opportunity to try and answer.
I also provided updates on AI Craziness Mitigation Efforts from OpenAI and Anthropic. We can all do better here.
Tomorrow, I’ll go over OpenAI's ‘recapitalization’ and reorganization, also known as one of the greatest thefts in human history. Compared to what we feared, it looks like we did relatively well [...]
---
Outline:
(02:01) Language Models Offer Mundane Utility
(06:37) Language Models Don't Offer Mundane Utility
(12:18) Huh, Upgrades
(14:55) On Your Marks
(16:40) Choose Your Fighter
(22:57) Get My Agent On The Line
(24:00) Deepfaketown and Botpocalypse Soon
(25:10) Fun With Media Generation
(28:42) Copyright Confrontation
(28:56) They Took Our Jobs
(30:50) Get Involved
(30:55) Introducing
(32:22) My Name is Neo
(34:38) In Other AI News
(36:50) Show Me the Money
(39:36) One Trillion Dollars For My Robot Army
(42:43) One Million TPUs
(45:57) Anthropic's Next Move
(46:55) Quiet Speculations
(53:26) The Quest for Sane Regulations
(58:54) The March of California Regulations
(01:06:49) Not So Super PAC
(01:08:32) Chip City
(01:12:52) The Week in Audio
(01:13:12) Do Not Take The Bait
(01:14:43) Rhetorical Innovation
(01:17:02) People Do Not Like AI
(01:18:08) Aligning a Smarter Than Human Intelligence is Difficult
(01:21:28) Misaligned!
(01:23:29) Anthropic Reports Claude Can Introspect
(01:30:59) Anthropic Reports On Sabotage Risks
(01:34:49) People Are Worried About AI Killing Everyone
(01:35:24) Other People Are Not As Worried About AI Killing Everyone
(01:38:08) The Lighter Side
---
First published:
October 30th, 2025
Source:
https://www.lesswrong.com/posts/TwbA3zTr99eh2kgCf/ai-140-trying-to-hold-the-line
---
Narrated by TYPE III AUDIO.
---
Images from the article:
Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
View all episodes
By zvi
5
22 ratings
Sometimes the best you can do is try to avoid things getting even worse even faster.
Thus, one has to write articles such as ‘Please Do Not Sell B30A Chips to China.’
It's rather crazy to think that one would have to say this out loud.
In the same way, it seems not only do we need to say out loud to Not Build Superintelligence Right Now, there are those who say how dare you issue such a statement without knowing how to do so safety, so instead we should build superintelligence without knowing how to do so safety. The alternative is to risk societal dynamics we do not know how to control and that could have big unintended consequences, you say? Yes, well.
One good thing to come out of that was that Sriram Krishnan asked (some of) the right questions, giving us the opportunity to try and answer.
I also provided updates on AI Craziness Mitigation Efforts from OpenAI and Anthropic. We can all do better here.
Tomorrow, I’ll go over OpenAI's ‘recapitalization’ and reorganization, also known as one of the greatest thefts in human history. Compared to what we feared, it looks like we did relatively well [...]
---
Outline:
(02:01) Language Models Offer Mundane Utility
(06:37) Language Models Don't Offer Mundane Utility
(12:18) Huh, Upgrades
(14:55) On Your Marks
(16:40) Choose Your Fighter
(22:57) Get My Agent On The Line
(24:00) Deepfaketown and Botpocalypse Soon
(25:10) Fun With Media Generation
(28:42) Copyright Confrontation
(28:56) They Took Our Jobs
(30:50) Get Involved
(30:55) Introducing
(32:22) My Name is Neo
(34:38) In Other AI News
(36:50) Show Me the Money
(39:36) One Trillion Dollars For My Robot Army
(42:43) One Million TPUs
(45:57) Anthropic's Next Move
(46:55) Quiet Speculations
(53:26) The Quest for Sane Regulations
(58:54) The March of California Regulations
(01:06:49) Not So Super PAC
(01:08:32) Chip City
(01:12:52) The Week in Audio
(01:13:12) Do Not Take The Bait
(01:14:43) Rhetorical Innovation
(01:17:02) People Do Not Like AI
(01:18:08) Aligning a Smarter Than Human Intelligence is Difficult
(01:21:28) Misaligned!
(01:23:29) Anthropic Reports Claude Can Introspect
(01:30:59) Anthropic Reports On Sabotage Risks
(01:34:49) People Are Worried About AI Killing Everyone
(01:35:24) Other People Are Not As Worried About AI Killing Everyone
(01:38:08) The Lighter Side
---
First published:
October 30th, 2025
Source:
https://www.lesswrong.com/posts/TwbA3zTr99eh2kgCf/ai-140-trying-to-hold-the-line
---
Narrated by TYPE III AUDIO.
---
Images from the article:
Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
More shows like LessWrong posts by zvi
View all
Making Sense with Sam Harris
26,380 Listeners
Conversations with Tyler
2,461 Listeners
The a16z Show
1,105 Listeners
Future of Life Institute Podcast
109 Listeners
ChinaTalk
291 Listeners
Politix
90 Listeners
Dwarkesh Podcast
551 Listeners
Hard Fork
5,576 Listeners
Clearer Thinking with Spencer Greenberg
137 Listeners
LessWrong (Curated & Popular)
13 Listeners
No Priors: Artificial Intelligence | Technology | Startups
150 Listeners
"Econ 102" with Noah Smith and Erik Torenberg
147 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
475 Listeners
LessWrong (30+ Karma)
0 Listeners
Complex Systems with Patrick McKenzie (patio11)
143 Listeners