LessWrong (30+ Karma)

“OpenAI Preparedness Framework 2.0” by Zvi


Listen Later

Right before releasing o3, OpenAI updated its Preparedness Framework to 2.0.
I previously wrote an analysis of the Preparedness Framework 1.0. I still stand by essentially everything I wrote in that analysis, which I reread to prepare before reading the 2.0 framework. If you want to dive deep, I recommend starting there, as this post will focus on changes from 1.0 to 2.0.
As always, I thank OpenAI for the document, and laying out their approach and plans.
I have several fundamental disagreements with the thinking behind this document.
In particular:
  1. The Preparedness Framework only applies to specific named and measurable things that might go wrong. It requires identification of a particular threat model that is all of: Plausible, measurable, severe, net new and (instantaneous or irremediable).
  2. The Preparedness Framework thinks ‘ordinary’ mitigation defense-in-depth strategies will be sufficient to handle High-level threats and likely even Critical-level [...]
  3. ---

    Outline:

    (02:05) Persuaded to Not Worry About It

    (08:55) The Medium Place

    (10:40) Thresholds and Adjustments

    (16:08) Release the Kraken Anyway, We Took Precautions

    (20:16) Misaligned!

    (23:47) The Safeguarding Process

    (26:43) But Mom, Everyone Is Doing It

    (29:36) Mission Critical

    (30:37) Research Areas

    (32:26) Long-Range Autonomy

    (32:51) Sandbagging

    (33:18) Replication and Adaptation

    (34:07) Undermining Safeguards

    (35:30) Nuclear and Radiological

    (35:53) Measuring Capabilities

    (38:06) Questions of Governance

    (41:10) Don't Be Nervous, Don't Be Flustered, Don't Be Scared, Be Prepared

    ---

    First published:

    May 2nd, 2025

    Source:

    https://www.lesswrong.com/posts/MsojzMC4WwxX3hjPn/openai-preparedness-framework-2-0

    ---

    Narrated by TYPE III AUDIO.

    ---

    Images from the article:

    Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    ...more
    View all episodesView all episodes
    Download on the App Store

    LessWrong (30+ Karma)By LessWrong


    More shows like LessWrong (30+ Karma)

    View all
    Making Sense with Sam Harris by Sam Harris

    Making Sense with Sam Harris

    26,367 Listeners

    Conversations with Tyler by Mercatus Center at George Mason University

    Conversations with Tyler

    2,397 Listeners

    The Peter Attia Drive by Peter Attia, MD

    The Peter Attia Drive

    7,779 Listeners

    Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

    Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

    4,103 Listeners

    ManifoldOne by Steve Hsu

    ManifoldOne

    87 Listeners

    Your Undivided Attention by Tristan Harris and Aza Raskin, The Center for Humane Technology

    Your Undivided Attention

    1,442 Listeners

    All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

    All-In with Chamath, Jason, Sacks & Friedberg

    8,778 Listeners

    Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

    Machine Learning Street Talk (MLST)

    89 Listeners

    Dwarkesh Podcast by Dwarkesh Patel

    Dwarkesh Podcast

    355 Listeners

    Hard Fork by The New York Times

    Hard Fork

    5,370 Listeners

    The Ezra Klein Show by New York Times Opinion

    The Ezra Klein Show

    15,053 Listeners

    Moonshots with Peter Diamandis by PHD Ventures

    Moonshots with Peter Diamandis

    460 Listeners

    No Priors: Artificial Intelligence | Technology | Startups by Conviction

    No Priors: Artificial Intelligence | Technology | Startups

    126 Listeners

    Latent Space: The AI Engineer Podcast by swyx + Alessio

    Latent Space: The AI Engineer Podcast

    64 Listeners

    BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

    BG2Pod with Brad Gerstner and Bill Gurley

    432 Listeners