Hi folks. As some of you know, I've been trying to write an article laying out the simplest case for AI catastrophe. I believe existing pieces are worse than they could be for fixable reasons. So I tried to write my own piece that's better. In the end, it ended up being longer and more detailed than perhaps the "simplest case" ought to be. I might rewrite it again in the future, pending feedback.

Anyway, below is the piece in its entirety:

___

1. The world's largest tech companies are building intelligences that will become better than humans at almost all economically and militarily relevant tasks.
2. Many of these intelligences will be goal-seeking minds acting in the real world, rather than just impressive pattern-matchers.
3. Unlike traditional software, we cannot specify what these minds will want or verify what they’ll do. We can only grow and shape them, and hope the shaping holds.
4. This can all end very badly.

The world's largest tech companies are building intelligences that will become better than humans at almost all economically and militarily relevant tasks

The CEOs of OpenAI, Google DeepMind, Anthropic, and Meta AI have all explicitly stated that building human-level or superhuman [...]

---

Outline:

(01:12) The world's largest tech companies are building intelligences that will become better than humans at almost all economically and militarily relevant tasks

(05:29) Many of these intelligences will be goal-seeking minds acting in the real world, rather than just impressive pattern-matchers

(09:34) Unlike traditional software, we cannot specify what these minds will want or verify what they'll do. We can only grow and shape them, and hope the shaping holds

(14:00) This can all end very badly

(17:03) Conclusion

The original text contained 14 footnotes which were omitted from this narration.

---

First published:

Source:

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.