LessWrong (30+ Karma)

“Safe Predictive Agents with Joint Scoring Rules” by Rubi J. Hudson


Listen Later

Audio note: this article contains 129 uses of latex notation, so the narration may be difficult to follow. There's a link to the original text in the episode description.

Thanks to Evan Hubinger for funding this project and for introducing me to predictive models, Johannes Treutlein for many fruitful discussions on related topics, and Dan Valentine for providing valuable feedback on my code implementation.

In September 2023, I received four months of funding through Manifund to extend my initial results on avoiding self-fulfilling prophecies in predictive models. Eleven months later, the project was finished, and the results were submitted as a conference paper.

The project was largely successful, in that it showed both theoretically and experimentally how incentives for predictive accuracy can be structed so that maximizing them does not manipulate outcomes to be more predictable. The mechanism at play is essentially pitting predictive agents [...]

---

Outline:

(01:45) Predictive Agents and Performative Prediction

(07:08) Model, Definitions, and Related Literature

(11:42) Theoretical Results

(16:16) Different Beliefs

(19:12) Efficient Search

(20:39) Stochastic Choice

(22:53) Unconditional Predictions

(25:49) Empirical Results

(29:52) Future Work

(32:02) Appendix

(32:17) Main Theorem

(34:45) Stochastic Choice Conditions

---

First published:

October 9th, 2024

Source:

https://www.lesswrong.com/posts/FFCDWx6qBdBds6jvL/safe-predictive-agents-with-joint-scoring-rules

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

...more
View all episodesView all episodes
Download on the App Store

LessWrong (30+ Karma)By LessWrong


More shows like LessWrong (30+ Karma)

View all
The Daily by The New York Times

The Daily

112,856 Listeners

Astral Codex Ten Podcast by Jeremiah

Astral Codex Ten Podcast

130 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,217 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

532 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,202 Listeners

AI Article Readings by Readings of great articles in AI voices

AI Article Readings

4 Listeners

Doom Debates by Liron Shapira

Doom Debates

14 Listeners

LessWrong posts by zvi by zvi

LessWrong posts by zvi

2 Listeners