LessWrong (30+ Karma)

“An overview of areas of control work” by ryan_greenblatt


Listen Later

In this post, I'll list all the areas of control research (and implementation) that seem promising to me.

This references framings and abstractions discussed in Prioritizing threats for AI control.

First, here is a division of different areas, though note that these areas have some overlaps:

  • Developing and using settings for control evaluations (including technique iteration)
  • Better understanding control-relevant capabilities and model properties
  • Developing specific countermeasures/techniques in isolation (rather than via iterating in a setting)
  • Doing control experiments on actual current AI usage
  • Prototyping or implementing software infrastructure for control and security measures that are particularly relevant to control
  • Prototyping or implementing human processes for control
  • Conceptual research and other ways of researching control other than empirical experiments
  • Nearer-term applications of control to practice and accelerate later usage of control
  • This division is imperfect and somewhat [...]

    ---

    Outline:

    (01:43) Developing and using settings for control evaluations

    (13:51) Better understanding control-relevant capabilities and model properties

    (28:21) Developing specific countermeasures/techniques in isolation

    (36:01) Doing control experiments on actual AI usage

    (40:43) Prototyping or implementing software infrastructure for control and security measures that are particularly relevant to control

    (41:58) Prototyping or implementing human processes for control

    (46:50) Conceptual research and other ways of researching control other than empirical experiments

    (49:37) Nearer-term applications of control to practice and accelerate later usage of control

    ---

    First published:

    March 25th, 2025

    Source:

    https://www.lesswrong.com/posts/Eeo9NrXeotWuHCgQW/an-overview-of-areas-of-control-work

    ---

    Narrated by TYPE III AUDIO.

    ...more
    View all episodesView all episodes
    Download on the App Store

    LessWrong (30+ Karma)By LessWrong


    More shows like LessWrong (30+ Karma)

    View all
    Making Sense with Sam Harris by Sam Harris

    Making Sense with Sam Harris

    26,354 Listeners

    Conversations with Tyler by Mercatus Center at George Mason University

    Conversations with Tyler

    2,444 Listeners

    The Peter Attia Drive by Peter Attia, MD

    The Peter Attia Drive

    9,124 Listeners

    Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

    Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

    4,154 Listeners

    ManifoldOne by Steve Hsu

    ManifoldOne

    92 Listeners

    Your Undivided Attention by The Center for Humane Technology, Tristan Harris, Daniel Barcay and Aza Raskin

    Your Undivided Attention

    1,595 Listeners

    All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

    All-In with Chamath, Jason, Sacks & Friedberg

    9,902 Listeners

    Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

    Machine Learning Street Talk (MLST)

    90 Listeners

    Dwarkesh Podcast by Dwarkesh Patel

    Dwarkesh Podcast

    506 Listeners

    Hard Fork by The New York Times

    Hard Fork

    5,471 Listeners

    The Ezra Klein Show by New York Times Opinion

    The Ezra Klein Show

    16,051 Listeners

    Moonshots with Peter Diamandis by PHD Ventures

    Moonshots with Peter Diamandis

    540 Listeners

    No Priors: Artificial Intelligence | Technology | Startups by Conviction

    No Priors: Artificial Intelligence | Technology | Startups

    131 Listeners

    Latent Space: The AI Engineer Podcast by swyx + Alessio

    Latent Space: The AI Engineer Podcast

    95 Listeners

    BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

    BG2Pod with Brad Gerstner and Bill Gurley

    521 Listeners