LessWrong posts by zvi

“Claude Sonnet 4.5: System Card and Alignment” by Zvi


Listen Later

Claude Sonnet 4.5 was released yesterday. Anthropic credibly describes it as the best coding, agentic and computer use model in the world. At least while I learn more, I am defaulting to it as my new primary model for queries short of GPT-5-Pro level.

I’ll cover the system card and alignment concerns first, then cover capabilities and reactions tomorrow once everyone has had another day to play with the new model.

It was great to recently see the collaboration between OpenAI and Anthropic where they evaluated each others’ models. I would love to see this incorporated into model cards going forward, where GPT-5 was included in Anthropic's system cards as a comparison point, and Claude was included in OpenAI's.

Basic Alignment Facts About Sonnet 4.5

Anthropic: Overall, we find that Claude Sonnet 4.5 has a substantially improved safety profile compared to previous Claude models.

[...]

---

Outline:

(01:36) Basic Alignment Facts About Sonnet 4.5

(03:54) 2.1: Single Turn Tests and 2.2: Ambiguous Context Evaluations

(05:01) 2.3. and 2.4: Multi-Turn Testing

(07:00) 2.5: Bias

(08:56) 3: Honesty

(10:26) 4: Agentic Safety

(10:41) 4.1: Malicious Agentic Coding

(13:01) 4.2: Prompt Injections Within Agentic Systems

(15:05) 5: Cyber Capabilities

(17:35) 5.3: Responsible Scaling Policy (RSP) Cyber Tests

(22:15) 6: Reward Hacking

(26:47) 7: Alignment

(28:11) Situational Awareness

(33:38) Test Design

(36:32) Evaluation Awareness

(42:57) 7.4: Evidence From Training And Early Use

(43:55) 7.5: Risk Area Discussions

(45:26) It's Sabotage

(50:48) Interpretability Investigations

(58:35) 8: Model Welfare Assessment

(58:54) 9: RSP (Responsible Scaling Policy) Evaluations

(59:51) Keep Sonnet Safe

---

First published:

September 30th, 2025

Source:

https://www.lesswrong.com/posts/4yn8B8p2YiouxLABy/claude-sonnet-4-5-system-card-and-alignment

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

...more
View all episodesView all episodes
Download on the App Store

LessWrong posts by zviBy zvi

  • 5
  • 5
  • 5
  • 5
  • 5

5

2 ratings


More shows like LessWrong posts by zvi

View all
Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,383 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,423 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,083 Listeners

Future of Life Institute Podcast by Future of Life Institute

Future of Life Institute Podcast

107 Listeners

ChinaTalk by Jordan Schneider

ChinaTalk

289 Listeners

Politix by Politix

Politix

93 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

489 Listeners

Hard Fork by The New York Times

Hard Fork

5,479 Listeners

Clearer Thinking with Spencer Greenberg by Spencer Greenberg

Clearer Thinking with Spencer Greenberg

132 Listeners

LessWrong (Curated & Popular) by LessWrong

LessWrong (Curated & Popular)

13 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

133 Listeners

"Econ 102" with Noah Smith and Erik Torenberg by Turpentine

"Econ 102" with Noah Smith and Erik Torenberg

151 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

509 Listeners

LessWrong (30+ Karma) by LessWrong

LessWrong (30+ Karma)

0 Listeners

Complex Systems with Patrick McKenzie (patio11) by Patrick McKenzie

Complex Systems with Patrick McKenzie (patio11)

133 Listeners