LessWrong (30+ Karma)

“It will cost you nothing to ‘bribe’ a Utilitarian” by Gabriel Alfour


Listen Later

Audio note: this article contains 41 uses of latex notation, so the narration may be difficult to follow. There's a link to the original text in the episode description.

Abstract

We present a formal model demonstrating how utilitarian reasoning creates a structural vulnerability that allows AI corporations to acquire a public veneer of safety at arbitrary low cost.

Drawing from the work from Houy [2014], we prove that an organisation can acquire _k_ safety minded employees for a vanishingly small premium _epsilon_.

This results formalises a well known phenomenon in AI safety, wherein researchers concerned about existential risks from AI joins an accelerationist corporation under the rationale of "changing things from the inside", without ever producing measurable safety improvements.

We discuss implications for AI governance, organisational credibility, and the limitations of utilitarian decision-making in competitive labour markets.

1) Introduction

The title is a play on It will [...]

---

Outline:

(00:22) Abstract

(01:13) 1) Introduction

(02:06) 2) Formal Framework

(04:42) 3) Implications

(06:22) 4) Future Work

(08:10) Conclusion

The original text contained 2 footnotes which were omitted from this narration.

---

First published:

October 15th, 2025

Source:

https://www.lesswrong.com/posts/MFg7nvR2QGd6KkLJZ/it-will-cost-you-nothing-to-bribe-a-utilitarian

---

Narrated by TYPE III AUDIO.

...more
View all episodesView all episodes
Download on the App Store

LessWrong (30+ Karma)By LessWrong


More shows like LessWrong (30+ Karma)

View all
The Daily by The New York Times

The Daily

111,948 Listeners

Astral Codex Ten Podcast by Jeremiah

Astral Codex Ten Podcast

130 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,230 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

576 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

15,950 Listeners

AI Article Readings by Readings of great articles in AI voices

AI Article Readings

4 Listeners

Doom Debates! by Liron Shapira

Doom Debates!

14 Listeners

LessWrong posts by zvi by zvi

LessWrong posts by zvi

2 Listeners