LessWrong (30+ Karma)

“In Defense of Open-Minded UDT” by abramdemski


Listen Later

Audio note: this article contains 33 uses of latex notation, so the narration may be difficult to follow. There's a link to the original text in the episode description.

Crossposted from the AI Alignment Forum. May contain more technical jargon than usual.

A Defense of Open-Minded Updatelessness, with applications to alignment.

This work owes a great debt to many conversations with Sahil, Martín Soto, and Scott Garrabrant.

Sahil and I will have a public discussion about this this Wednesday (August 14) at 11am EDT; join via this link.

You can support my work on Patreon.

Iterated Counterfactual Mugging On a Single Coinflip

Iterated counterfactual mugging on a single coinflip begins like a classic counterfactual mugging, with Omega approaching you, explaining the situation, and asking for your money. Let's say you buy the classic UDT idea, so you happily give Omega your money.

Next week, Omega appears again [...]

---

Outline:

(00:44) Iterated Counterfactual Mugging On a Single Coinflip

(03:28) UDT vs Learning

(09:24) Possible Critiques

(19:29) Bargaining

The original text contained 9 footnotes which were omitted from this narration.

---

First published:

August 12th, 2024

Source:

https://www.lesswrong.com/posts/p8zxx9pZvMRcoqZDm/in-defense-of-open-minded-udt

---

Narrated by TYPE III AUDIO.

...more
View all episodesView all episodes
Download on the App Store

LessWrong (30+ Karma)By LessWrong


More shows like LessWrong (30+ Karma)

View all
The Daily by The New York Times

The Daily

113,290 Listeners

Astral Codex Ten Podcast by Jeremiah

Astral Codex Ten Podcast

132 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,259 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

566 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,498 Listeners

AI Article Readings by Readings of great articles in AI voices

AI Article Readings

4 Listeners

Doom Debates! by Liron Shapira

Doom Debates!

14 Listeners

LessWrong posts by zvi by zvi

LessWrong posts by zvi

2 Listeners