80k After Hours

Highlights: #214 – Buck Shlegeris on controlling AI that wants to take over – so we can use it anyway


Listen Later

Most AI safety conversations centre on alignment: ensuring AI systems share our values and goals. But despite progress, we’re unlikely to know we’ve solved the problem before the arrival of human-level and superhuman systems in as little as three years.

So some — including Buck Shlegeris, CEO of Redwood Research — are developing a backup plan to safely deploy models we fear are actively scheming to harm us: so-called “AI control.” While this may sound mad, given the reluctance of AI companies to delay deploying anything they train, not developing such techniques is probably even crazier.

These highlights are from episode #214 of The 80,000 Hours Podcast: Buck Shlegeris on controlling AI that wants to take over – so we can use it anyway, and include:

  • What is AI control? (00:00:15)
  • One way to catch AIs that are up to no good (00:07:00)
  • What do we do once we catch a model trying to escape? (00:13:39)
  • Team Human vs Team AI (00:18:24)
  • If an AI escapes, is it likely to be able to beat humanity from there? (00:24:59)
  • Is alignment still useful? (00:32:10)
  • Could 10 safety-focused people in an AGI company do anything useful? (00:35:34)

These aren't necessarily the most important or even most entertaining parts of the interview — so if you enjoy this, we strongly recommend checking out the full episode!

And if you're finding these highlights episodes valuable, please let us know by emailing [email protected].

Highlights put together by Ben Cordell, Milo McGuire, and Dominic Armstrong

...more
View all episodesView all episodes
Download on the App Store

80k After HoursBy The 80,000 Hours team

  • 5
  • 5
  • 5
  • 5
  • 5

5

15 ratings


More shows like 80k After Hours

View all
Planet Money by NPR

Planet Money

30,771 Listeners

The Right Time with Bomani Jones by Wave Originals

The Right Time with Bomani Jones

12,771 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,425 Listeners

Uncomfortable Conversations with Josh Szeps by Josh Szeps

Uncomfortable Conversations with Josh Szeps

853 Listeners

Hidden Brain by Hidden Brain, Shankar Vedantam

Hidden Brain

43,819 Listeners

Pod Save America by Crooked Media

Pod Save America

87,549 Listeners

The Daily by The New York Times

The Daily

112,398 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,058 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

453 Listeners

People I (Mostly) Admire by Freakonomics Radio + Stitcher

People I (Mostly) Admire

2,099 Listeners

Hard Fork by The New York Times

Hard Fork

5,505 Listeners

Clearer Thinking with Spencer Greenberg by Spencer Greenberg

Clearer Thinking with Spencer Greenberg

129 Listeners

Huberman Lab by Scicomm Media

Huberman Lab

29,378 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,007 Listeners

How I Learned to Love Shrimp by James Özden

How I Learned to Love Shrimp

17 Listeners