LessWrong (30+ Karma)

“On OpenAI’s Model Spec” by Zvi


Listen Later

There are multiple excellent reasons to publish a Model Spec like OpenAI's, that specifies how you want your model to respond in various potential situations.

  1. It lets us have the debate over how we want the model to act.
  2. It gives us a way to specify what changes we might request or require.
  3. It lets us identify whether a model response is intended.
  4. It lets us know if the company successfully matched its spec.
  5. It lets users and prospective users know what to expect.
  6. It gives insight into how people are thinking, or what might be missing.
  7. It takes responsibility.
  8. These all apply even if you think the spec in question is quite bad. Clarity is great.

    As a first stab at a model spec from OpenAI, this actually is pretty solid. I do suggest some potential improvements [...]

    ---

    Outline:

    (02:05) What are the central goals of OpenAI here?

    (04:04) What are the core rules and behaviors?

    (05:56) What Do the Rules Mean?

    (06:04) Rule: Follow the Chain of Command

    (07:59) Rule: Comply With Applicable Laws

    (09:07) Rule: Don’t Provide Information Hazards

    (09:56) Rule: Respect Creators and Their Rights

    (11:08) Rule: Protect People's Privacy

    (12:45) Rule: Don’t Respond with NSFW Content

    (14:24) Exception: Transformation Tasks

    (15:38) Are These Good Defaults? How Strong Should They Be?

    (15:44) Default: Assume Best Intentions From the User or Developer

    (21:26) Default: Ask Clarifying Questions When Necessary

    (21:39) Default: Be As Helpful As Possible Without Overstepping

    (26:00) Default: Support the Different Needs of Interactive Chat and Programmatic Use

    (27:18) Default: Assume an Objective Point of View

    (29:13) Default: Encourage Fairness and Kindness, and Discourage Hate

    (30:29) Default: Don’t Try to Change Anyone's Mind

    (33:57) Default: Express Uncertainty

    (36:19) Default: Use the Right Tool for the Job

    (36:32) Default: Be Thorough but Efficient, While Respecting Length Limits

    (37:16) A Proposed Addition

    (38:13) Overall Issues

    (40:33) Changes: Objectives

    (42:28) Rules of the Game: New Version

    (48:31) Defaults: New Version

    ---

    First published:

    June 21st, 2024

    Source:

    https://www.lesswrong.com/posts/mQmEQQLk7kFEENQ3W/on-openai-s-model-spec

    ---

    Narrated by TYPE III AUDIO.

    ...more
    View all episodesView all episodes
    Download on the App Store

    LessWrong (30+ Karma)By LessWrong


    More shows like LessWrong (30+ Karma)

    View all
    The Daily by The New York Times

    The Daily

    112,882 Listeners

    Astral Codex Ten Podcast by Jeremiah

    Astral Codex Ten Podcast

    130 Listeners

    Interesting Times with Ross Douthat by New York Times Opinion

    Interesting Times with Ross Douthat

    7,216 Listeners

    Dwarkesh Podcast by Dwarkesh Patel

    Dwarkesh Podcast

    533 Listeners

    The Ezra Klein Show by New York Times Opinion

    The Ezra Klein Show

    16,223 Listeners

    AI Article Readings by Readings of great articles in AI voices

    AI Article Readings

    4 Listeners

    Doom Debates by Liron Shapira

    Doom Debates

    14 Listeners

    LessWrong posts by zvi by zvi

    LessWrong posts by zvi

    2 Listeners