LessWrong (30+ Karma)

Unless its governance changes, Anthropic is untrustworthy


Listen Later

Anthropic is untrustworthy.

This post provides arguments, asks questions, and documents some examples of Anthropic's leadership being misleading and deceptive, holding contradictory positions that consistently shift in OpenAI's direction, lobbying to kill and water down regulation so helpful that employees of all major AI companies speak out to support it, and violating the fundamental promise the company was founded on. It also shares a few previously unreported details on Anthropic leadership's promises and efforts.[1]

Anthropic has a strong internal culture that has broadly EA views and values, and the company has strong pressures to appear to follow these views and values as it wants to retain talent and the loyalty of staff, but it's very unclear what they would do when it matters most. Their staff should demand answers.

There's a details box here with the title "Suggested questions for Anthropic employees to ask themselves, Dario, the policy team, and the board after reading this post, and for Dario and the board to answer publicly". The box contents are omitted from this narration.

I would like to thank everyone who provided feedback on the draft; was willing to share information; and raised awareness of some of the facts discussed here.

[...]

---

Outline:

(01:34) 0. What was Anthropics supposed reason for existence?

(05:01) 1. In private, Dario frequently said he won't push the frontier of AI capabilities; later, Anthropic pushed the frontier

(10:54) 2. Anthropic said it will act under the assumption we might be in a pessimistic scenario, but it doesn't seem to do this

(14:40) 3. Anthropic doesnt have strong independent value-aligned governance

(14:47) Anthropic pursued investments from the UAE and Qatar

(17:32) The Long-Term Benefit Trust might be weak

(18:06) More general issues

(19:14) 4. Anthropic had secret non-disparagement agreements

(21:58) 5. Anthropic leaderships lobbying contradicts their image

(24:05) Europe

(24:44) SB-1047

(34:04) Dario argued against any regulation except for transparency requirements

(34:39) Jack Clark publicly lied about the NY RAISE Act

(36:39) Jack Clark tried to push for federal preemption

(37:04) 6. Anthropics leadership quietly walked back the RSP commitments

(37:55) Unannounced removal of the commitment to plan for a pause in scaling

(38:52) Unannounced change in October 2024 on defining ASL-N+1 by the time ASL-N is reached

(40:33) The last-minute change in May 2025 on insider threats

(41:11) 7. Why does Anthropic really exist?

(47:09) 8. Conclusion

The original text contained 11 footnotes which were omitted from this narration.

---

First published:

November 29th, 2025

Source:

https://www.lesswrong.com/posts/5aKRshJzhojqfbRyo/unless-its-governance-changes-anthropic-is-untrustworthy

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

...more
View all episodesView all episodes
Download on the App Store

LessWrong (30+ Karma)By LessWrong


More shows like LessWrong (30+ Karma)

View all
Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,344 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,451 Listeners

The Peter Attia Drive by Peter Attia, MD

The Peter Attia Drive

8,621 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,187 Listeners

ManifoldOne by Steve Hsu

ManifoldOne

93 Listeners

Your Undivided Attention by The Center for Humane Technology, Tristan Harris, Daniel Barcay and Aza Raskin

Your Undivided Attention

1,598 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,904 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

95 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

503 Listeners

Hard Fork by The New York Times

Hard Fork

5,525 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

15,955 Listeners

Moonshots with Peter Diamandis by PHD Ventures

Moonshots with Peter Diamandis

545 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

133 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

94 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

470 Listeners