LessWrong (30+ Karma)

“Iterated Development and Study of Schemers (IDSS)” by ryan_greenblatt


Listen Later

In a previous post, we discussed prospects for studying scheming using natural examples. In this post, we'll describe a more detailed proposal for iteratively constructing scheming models, techniques for detecting scheming, and techniques for preventing scheming. We'll call this strategy Iterated Development and Study of Schemers (IDSS). We'll be using concepts from that prior post, like the idea of trying to make schemers which are easier to catch.

Two key difficulties with using natural examples of scheming are that it is hard to catch (and re-catch) schemers and that it's hard to (cheaply) get a large number of diverse examples of scheming to experiment on. One approach for partially resolving these issues is to experiment on weak schemers which are easier to catch and cheaper to experiment on. However, these weak schemers might not be analogous to the powerful schemers which are actually dangerous, and these weak AIs [...]

---

Outline:

(01:36) The IDSS strategy

(02:10) Iterated development of scheming testbeds

(04:35) Gradual addition of capabilities

(08:39) Using improved testbeds for improving scheming mitigation techniques

(09:09) What can go wrong with IDSS?

(13:20) Conclusion

The original text contained 2 footnotes which were omitted from this narration.

---

First published:

October 10th, 2025

Source:

https://www.lesswrong.com/posts/QpzTmFLXMJcdRkPLZ/iterated-development-and-study-of-schemers-idss

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

...more
View all episodesView all episodes
Download on the App Store

LessWrong (30+ Karma)By LessWrong


More shows like LessWrong (30+ Karma)

View all
The Daily by The New York Times

The Daily

113,207 Listeners

Astral Codex Ten Podcast by Jeremiah

Astral Codex Ten Podcast

130 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,258 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

534 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,291 Listeners

AI Article Readings by Readings of great articles in AI voices

AI Article Readings

4 Listeners

Doom Debates by Liron Shapira

Doom Debates

14 Listeners

LessWrong posts by zvi by zvi

LessWrong posts by zvi

2 Listeners