
Sign up to save your podcasts
Or
Audio note: this article contains 33 uses of latex notation, so the narration may be difficult to follow. There's a link to the original text in the episode description.
Crossposted from the AI Alignment Forum. May contain more technical jargon than usual.A Defense of Open-Minded Updatelessness, with applications to alignment.
This work owes a great debt to many conversations with Sahil, Martín Soto, and Scott Garrabrant.
Sahil and I will have a public discussion about this this Wednesday (August 14) at 11am EDT; join via this link.
You can support my work on Patreon.
Iterated Counterfactual Mugging On a Single Coinflip
Iterated counterfactual mugging on a single coinflip begins like a classic counterfactual mugging, with Omega approaching you, explaining the situation, and asking for your money. Let's say you buy the classic UDT idea, so you happily give Omega your money.
Next week, Omega appears again [...]
---
Outline:
(00:44) Iterated Counterfactual Mugging On a Single Coinflip
(03:28) UDT vs Learning
(09:24) Possible Critiques
(19:29) Bargaining
The original text contained 9 footnotes which were omitted from this narration.
---
First published:
Source:
Narrated by TYPE III AUDIO.
Audio note: this article contains 33 uses of latex notation, so the narration may be difficult to follow. There's a link to the original text in the episode description.
Crossposted from the AI Alignment Forum. May contain more technical jargon than usual.A Defense of Open-Minded Updatelessness, with applications to alignment.
This work owes a great debt to many conversations with Sahil, Martín Soto, and Scott Garrabrant.
Sahil and I will have a public discussion about this this Wednesday (August 14) at 11am EDT; join via this link.
You can support my work on Patreon.
Iterated Counterfactual Mugging On a Single Coinflip
Iterated counterfactual mugging on a single coinflip begins like a classic counterfactual mugging, with Omega approaching you, explaining the situation, and asking for your money. Let's say you buy the classic UDT idea, so you happily give Omega your money.
Next week, Omega appears again [...]
---
Outline:
(00:44) Iterated Counterfactual Mugging On a Single Coinflip
(03:28) UDT vs Learning
(09:24) Possible Critiques
(19:29) Bargaining
The original text contained 9 footnotes which were omitted from this narration.
---
First published:
Source:
Narrated by TYPE III AUDIO.
26,409 Listeners
2,387 Listeners
7,908 Listeners
4,131 Listeners
87 Listeners
1,457 Listeners
9,042 Listeners
87 Listeners
388 Listeners
5,432 Listeners
15,201 Listeners
474 Listeners
122 Listeners
75 Listeners
454 Listeners