Redwood Research Blog

“7+ tractable directions in AI control” by Ryan Greenblatt


Listen Later

Subtitle: A list of easy-to-start directions in AI control targeted at independent researchers without as much context or compute.

In this post, we list 7 of our favorite easy-to-start directions in AI control. (Really, projects that are at least adjacent to AI control; We include directions which aren’t as centrally AI control and which also have other motivations.) This list is targeted at independent researchers who don't necessarily have a ton of context on AI control (but have at least some context via e.g., having read some of our posts on control) and who don't want to do infrastructure and compute heavy experiments. In the final section, we also list 3 additional directions that are probably a bit more challenging but still tractable.

We’ll mostly be highlighting and expanding upon areas that Ryan discussed in an earlier post: An overview of areas of control work.

We don’t discuss [...]

---

Outline:

(01:29) Techniques for doing elicitation without learning and studying overelicitation

(03:35) Generating indistinguishable synthetic inputs

(07:09) Teaching models synthetic facts

(10:38) Further studying exploration hacking

(14:00) Malign AI agent substitution

(15:02) Studying data poisoning

(16:55) Training attack policies

(18:58) Bonus: 3 slightly more challenging (but important and tractable) directions

(19:05) Few-shot catastrophe prevention

(20:48) Studying collusion and developing countermeasures

(22:53) Studying steganography and developing countermeasures

The original text contained 1 footnote which was omitted from this narration.

---

First published:

April 29th, 2025

Source:

https://redwoodresearch.substack.com/p/7-tractable-directions-in-ai-control

---

Narrated by TYPE III AUDIO.

...more
View all episodesView all episodes
Download on the App Store

Redwood Research BlogBy Redwood Research