Written in personal capacity

I'm proposing UtopiaBench: a benchmark for posts that describe future scenarios that are good, specific, and plausible.

The AI safety community has been using vingettes to analyze and red-team threat models for a while. This is valuable because an understanding of how things can go wrong helps coordinate efforts to prevent the biggest and most urgent risks.

However, visions for the future can have self-fulfilling properties. Consider a world similar to our own, but there is no widely shared belief that transformative AI is on the horizon: AI companies would not be able to raise the money they do, and therefore transformative AI would be much less likely to be developed as quickly as in our actual timeline.

Currently, the AI safety community and the broader world lack a shared vision for good futures, and I think it'd be good to fix this.

Three desiderata for such visions include that they describe a world that is good, are specific, and plausible. It is hard to satisfy all properties, and we should therefore aim to improve the pareto frontier of visions of utopia along these three axes.

I asked Claude to create a basic PoC of [...]

---

First published:

Source:

---

Narrated by TYPE III AUDIO.