Epistemic status: shower thought quickly sketched, but I do have a PhD in this.

As we approach AGI and need to figure out what goals to give it we will need to find tractable ways to resolve moral disagreement. One of the most intractable moral disagreements is between the moral realists and the moral antirealists.

There's an oversimplified view of this disagreement that goes:

• If you're a moral realist, you want to align AGI to the best moral-epistemic deliberative processes you can find to figure out what is right
• If you're a moral antirealist and you're a unilateralist, you want to stage a coup and tile the world with your values
• If you're a moral realist and you're cooperative, you want to align AGI to a democratic process that locks in whatever values people have today forever

This oversimplified picture gets a lot of play, but it turns [...]

---

Outline:

(03:01) Moral epistemology naturalized

(05:48) Implications

(07:45) How to reject my view

---

First published:

Source:

---

Narrated by TYPE III AUDIO.