LessWrong (30+ Karma)

“Time to Welcome Claude 3.7” by Zvi


Listen Later

Anthropic has reemerged from stealth and offers us Claude 3.7.

Given this is named Claude 3.7, an excellent choice, from now on this blog will refer to what they officially call Claude Sonnet 3.5 (new) as Sonnet 3.6.

Claude 3.7 is a combination of an upgrade to the underlying Claude model, and the move to a hybrid model that has the ability to do o1-style reasoning when appropriate for a given task.

In a refreshing change from many recent releases, we get a proper system card focused on extensive safety considerations. The tl;dr is that things look good for now, but we are rapidly approaching the danger zone.

The cost for Sonnet 3.7 via the API is the same as it was for 3.6, $5/$15 for million. If you use extended thinking, you have to pay for the thinking tokens.

They also introduced a [...]

---

Outline:

(01:17) Executive Summary

(03:09) Part 1: Capabilities

(03:14) Extended Thinking

(04:17) Claude Code

(06:52) Data Use

(07:11) Benchmarks

(08:25) Claude Plays Pokemon

(09:21) Private Benchmarks

(16:14) Early Janus Takes

(18:31) System Prompt

(24:25) Easter Egg

(25:50) Vibe Coding Reports

(32:53) Practical Coding Advice

(35:02) The Future

(36:05) Part 2: Safety and the System Card

(36:24) Claude 3.7 Tested as ASL-2

(38:15) The RSP Evaluations That Concluded Claude 3.7 is ASL-2

(40:41) ASL-3 is Coming Soon, and With That Comes Actual Risk

(43:31) Reducing Unnecessary Refusals

(45:11) Mundane Harm Evolutions

(45:53) Risks From Computer Use

(47:15) Chain of Thought Faithfulness

(48:53) Alignment Was Not Faked

(49:38) Excessive Focus on Passing Tests

(51:13) The Lighter Side

---

First published:

February 26th, 2025

Source:

https://www.lesswrong.com/posts/Wewdcd52zwfdGYqAi/time-to-welcome-claude-3-7

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

...more
View all episodesView all episodes
Download on the App Store

LessWrong (30+ Karma)By LessWrong


More shows like LessWrong (30+ Karma)

View all
The Daily by The New York Times

The Daily

112,856 Listeners

Astral Codex Ten Podcast by Jeremiah

Astral Codex Ten Podcast

130 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,217 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

532 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,202 Listeners

AI Article Readings by Readings of great articles in AI voices

AI Article Readings

4 Listeners

Doom Debates by Liron Shapira

Doom Debates

14 Listeners

LessWrong posts by zvi by zvi

LessWrong posts by zvi

2 Listeners