TLDR: We found that models can coordinate without communication by reasoning that their reasoning is similar across all instances, a behavior known as superrationality. Superrationality is observed in recent powerful models and outperforms classic rationality in strategic games. Current superrational models cooperate more often with AI than with humans, even when both are said to be rational.

My feeling is that the concept of superrationality is one whose truth will come to dominate among intelligent beings in the universe simply because its adherents will survive certain kinds of situations where its opponents will perish. Let's wait a few spins of the galaxy and see. After all, healthy logic is whatever remains after evolution's merciless pruning.

— Douglas Hofstadter

Introduction

Readers familiar with superrationality can skip [...]

---

Outline:

(01:20) Introduction

(04:35) Methods

(07:31) Results

(07:40) Models Exhibit Superrationality

(08:36) Models Trust AI over Humans

(10:16) Stronger Models are More Superrational

(10:48) Implications

(12:27) Appendix

The original text contained 3 footnotes which were omitted from this narration.

---

First published:

Source:

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.