Awhile ago, Nate Soares wrote the posts Decision theory does not imply that we get to have nice things and Cosmopolitan values don't come free and But why would the AI kill us?

Paul Christiano put forth some arguments that "it seems pretty plausible that AI will be at least somewhat 'nice'", similar to how humans are somewhat nice to animals. There was some back-and-forth.

More recently we had Eliezer's post ASIs will not leave just a little sunlight for Earth.

I have a sense that something feels "unresolved" here. The current comments on Eliezer's post look likely to be rehashing the basics and I'd like to actually make some progress on distilling the best arguments. I'd like it if we got more explicit debate about this.

I also have some sense that the people previously involved (i.e. Nate, Paul, Eliezer) are sort of tired of [...]

---

Outline:

(01:17) Paul and Nate

(35:40) Eliezer Briefly Chimes in

(36:06) Paul and Oliver

The original text contained 1 footnote which was omitted from this narration.

---

First published:

Source:

Narrated by TYPE III AUDIO.