LessWrong (30+ Karma)

“Claude 4 You: The Quest for Mundane Utility” by Zvi


Listen Later

How good are Claude Opus 4 and Claude Sonnet 4?

They’re good models, sir.

If you don’t care about price or speed, Opus is probably the best model available today.

If you do care somewhat, Sonnet 4 is probably best in its class for many purposes, and deserves the 4 label because of its agentic aspects but isn’t a big leap over 3.7 for other purposes. I have been using 90%+ Opus so I can’t speak to this directly. There are some signs of some amount of ‘small model smell’ where Sonnet 4 has focused on common cases at the expense of rarer ones. That's what Opus is for.

That's all as of when I hit post. Things do escalate quickly these days, although I would not include Grok in this loop until proven otherwise, it's a three horse race and if you told me [...]

---

Outline:

(01:17) On Your Marks

(05:32) Standard Silly Benchmarks

(11:09) API Upgrades

(12:45) Coding Time Horizon

(13:47) The Key Missing Feature is Memory

(14:52) Early Reactions

(26:12) Opus 4 Has the Opus Nature

(32:27) Unprompted Attention

(35:09) Max Subscription

(36:24) In Summary

---

First published:

May 26th, 2025

Source:

https://www.lesswrong.com/posts/cQizFzEvZ8esKJGST/claude-4-you-the-quest-for-mundane-utility

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

...more
View all episodesView all episodes
Download on the App Store

LessWrong (30+ Karma)By LessWrong


More shows like LessWrong (30+ Karma)

View all
Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,469 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,395 Listeners

The Peter Attia Drive by Peter Attia, MD

The Peter Attia Drive

7,953 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,145 Listeners

ManifoldOne by Steve Hsu

ManifoldOne

89 Listeners

Your Undivided Attention by Tristan Harris and Aza Raskin, The Center for Humane Technology

Your Undivided Attention

1,472 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,207 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

88 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

426 Listeners

Hard Fork by The New York Times

Hard Fork

5,462 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

15,335 Listeners

Moonshots with Peter Diamandis by PHD Ventures

Moonshots with Peter Diamandis

482 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

121 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

75 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

461 Listeners