Sign up to save your podcasts
Or
Share “o3 Will Use Its Tools For You” by Zvi
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
“o3 Will Use Its Tools For You” by Zvi
OpenAI has finally introduced us to the full o3 along with o4-mini.
Greg Brockman (OpenAI): Just released o3 and o4-mini! These models feel incredibly smart.
We’ve heard from top scientists that they produce useful novel ideas.
Excited to see their positive impact on people's daily lives and humanity's hardest problems!
Sam Altman: we expect to release o3-pro to the pro tier in a few weeks
By all accounts, this upgrade is a big deal. They are giving us a modestly more intelligent model, but more importantly giving it better access to tools and ability to discern when to use them, to help get more practical value out of it. The tool use, and the ability to string it together and persist, is where o3 shines.
The highest praise I can give o3 is that this was by far the most a model has been used as part of writing its [...]
---
Outline:
(01:56) What's In a Name
(02:51) My Current Model Use Heuristics
(04:21) Huh, Upgrades
(05:31) Use All the Tools
(09:47) Search the Web
(10:27) On Your Marks
(18:15) The System Prompt
(19:00) The o3 and o4-mini System Card
(23:17) Tests o3 Aced
(25:14) Hallucinations
(31:41) Instruction Hierarchy
(32:52) Image Refusals
(33:18) METR Evaluations for Task Duration and Misalignment
(42:45) Apollo Evaluations for Scheming and Deception
(44:40) We Are Insufficiently Worried About These Alignment Failures
(47:16) GPT-4.1 Also Has Some Issues
(50:08) Pattern Lab Evaluations for Cybersecurity
(51:45) Preparedness Framework Tests
(52:14) Biological and Chemical Risks (4.2)
(58:20) Cybersecurity (4.3)
(59:27) AI Self-Improvement (4.4)
(01:00:51) Perpetual Shilling
(01:01:54) High Praise
(01:09:31) Syncopathy
(01:11:58) Mundane Utility Versus Capability Watch
(01:16:33) o3 Offers Mundane Utility
(01:24:10) o3 Doesn't Offer Mundane Utility
(01:30:54) o4-mini Also Exists
(01:31:31) Colin Fraser Dumb Model Watch
(01:32:52) o3 as Forecaster
(01:34:31) Is This AGI?
---
First published:
April 18th, 2025
Source:
https://www.lesswrong.com/posts/u58AyZziQRAcbhTxd/o3-will-use-its-tools-for-you
---
Narrated by TYPE III AUDIO.
---
Images from the article:
Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
View all episodes
By zvi
5
22 ratings
OpenAI has finally introduced us to the full o3 along with o4-mini.
Greg Brockman (OpenAI): Just released o3 and o4-mini! These models feel incredibly smart.
We’ve heard from top scientists that they produce useful novel ideas.
Excited to see their positive impact on people's daily lives and humanity's hardest problems!
Sam Altman: we expect to release o3-pro to the pro tier in a few weeks
By all accounts, this upgrade is a big deal. They are giving us a modestly more intelligent model, but more importantly giving it better access to tools and ability to discern when to use them, to help get more practical value out of it. The tool use, and the ability to string it together and persist, is where o3 shines.
The highest praise I can give o3 is that this was by far the most a model has been used as part of writing its [...]
---
Outline:
(01:56) What's In a Name
(02:51) My Current Model Use Heuristics
(04:21) Huh, Upgrades
(05:31) Use All the Tools
(09:47) Search the Web
(10:27) On Your Marks
(18:15) The System Prompt
(19:00) The o3 and o4-mini System Card
(23:17) Tests o3 Aced
(25:14) Hallucinations
(31:41) Instruction Hierarchy
(32:52) Image Refusals
(33:18) METR Evaluations for Task Duration and Misalignment
(42:45) Apollo Evaluations for Scheming and Deception
(44:40) We Are Insufficiently Worried About These Alignment Failures
(47:16) GPT-4.1 Also Has Some Issues
(50:08) Pattern Lab Evaluations for Cybersecurity
(51:45) Preparedness Framework Tests
(52:14) Biological and Chemical Risks (4.2)
(58:20) Cybersecurity (4.3)
(59:27) AI Self-Improvement (4.4)
(01:00:51) Perpetual Shilling
(01:01:54) High Praise
(01:09:31) Syncopathy
(01:11:58) Mundane Utility Versus Capability Watch
(01:16:33) o3 Offers Mundane Utility
(01:24:10) o3 Doesn't Offer Mundane Utility
(01:30:54) o4-mini Also Exists
(01:31:31) Colin Fraser Dumb Model Watch
(01:32:52) o3 as Forecaster
(01:34:31) Is This AGI?
---
First published:
April 18th, 2025
Source:
https://www.lesswrong.com/posts/u58AyZziQRAcbhTxd/o3-will-use-its-tools-for-you
---
Narrated by TYPE III AUDIO.
---
Images from the article:
Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
More shows like LessWrong posts by zvi
View all
Making Sense with Sam Harris
26,380 Listeners
Conversations with Tyler
2,461 Listeners
The a16z Show
1,105 Listeners
Future of Life Institute Podcast
109 Listeners
ChinaTalk
291 Listeners
Politix
90 Listeners
Dwarkesh Podcast
551 Listeners
Hard Fork
5,576 Listeners
Clearer Thinking with Spencer Greenberg
137 Listeners
LessWrong (Curated & Popular)
13 Listeners
No Priors: Artificial Intelligence | Technology | Startups
150 Listeners
"Econ 102" with Noah Smith and Erik Torenberg
147 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
475 Listeners
LessWrong (30+ Karma)
0 Listeners
Complex Systems with Patrick McKenzie (patio11)
143 Listeners