LessWrong (30+ Karma)

“Thoughts on ‘The Offense-Defense Balance Rarely Changes’” by Cullen


Listen Later

Personal Views Only

Introduction.

I thought Maxwell Tabarrok's The Offense-Defense Balance Rarely Changes was a good contribution to the discourse, and appreciated his attempt to use various lines of data to “kick the tires” on the case that an AI could in principle defeat all humans by inventing technologies that would allow them to dominate humans. I think Tabarrok is correct that this is a crux in the debate about how pessimistic to be about the possibility of humanity defending ourselves against a misaligned AGI,[1] and so in turn a crux about the probability of extinction or similarly bad outcomes from misaligned AI.

One thing I think Tabarrok is importantly correct about is that the idea of an “offense–defense balance” in hypothetical future human–AI conflicts is important but often undertheorized. Anyone interested in this question should be humbled by the fact that offense–defense theory and its [...]



---

Outline:

(01:26) Why I am not as reassured by the historical trends in conflict fatality rates as Tabarrok

(02:17) Reason 1: Deaths in conflict is not a measure of the offense–defense balance

(04:03) Reason 2: Only a temporary period of offense-dominance may be sufficient for AI takeover.

(05:29) Reason 3: AI might not need to defend itself against humans wielding AI-made offensive weapons.

(07:30) Reason 4: The destructiveness of the most destructive conflicts is increasing

The original text contained 7 footnotes which were omitted from this narration.

---

First published:

February 12th, 2024

Source:

https://www.lesswrong.com/posts/doBDpwEx48L54izSo/thoughts-on-the-offense-defense-balance-rarely-changes

---

Narrated by TYPE III AUDIO.

...more
View all episodesView all episodes
Download on the App Store

LessWrong (30+ Karma)By LessWrong


More shows like LessWrong (30+ Karma)

View all
The Daily by The New York Times

The Daily

113,164 Listeners

Astral Codex Ten Podcast by Jeremiah

Astral Codex Ten Podcast

130 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,255 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

535 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,266 Listeners

AI Article Readings by Readings of great articles in AI voices

AI Article Readings

4 Listeners

Doom Debates by Liron Shapira

Doom Debates

14 Listeners

LessWrong posts by zvi by zvi

LessWrong posts by zvi

2 Listeners