Doom Debates

The AI Corrigibility Debate: MIRI Researchers Max Harms vs. Jeremy Gillen


Listen Later

Max Harms and Jeremy Gillen are current and former MIRI researchers who both see superintelligent AI as an imminent extinction threat.

But they disagree on whether it’s worthwhile to try to aim for obedient, “corrigible” AI as a singular target for current alignment efforts.

Max thinks corrigibility is the most plausible path to build ASI without losing control and dying, while Jeremy is skeptical that this research path will yield better superintelligent AI behavior on a sufficiently early try.

By listening to this debate, you’ll find out if AI corrigibility is a relatively promising effort that might prevent imminent human extinction, or an over-optimistic pipe dream.

Timestamps

0:00 — Episode Preview

1:18 — Debate Kickoff

3:22 — What is Corrigibility?

9:57 — Why Corrigibility Matters

11:41 — What’s Your P(Doom)™

16:10 — Max’s Case for Corrigibility

19:28 — Jeremy’s Case Against Corrigibility

21:57 — Max’s Mainline AI Scenario

28:51 — 4 Strategies: Alignment, Control, Corrigibility, Don’t Build It

37:00 — Corrigibility vs HHH (”Helpful, Harmless, Honest”)

44:43 — Asimov’s 3 Laws of Robotics

52:05 — Is Corrigibility a Coherent Concept?

1:03:32 — Corrigibility vs Shutdown-ability

1:09:59 — CAST: Corrigibility as Singular Target, Near Misses, Iterations

1:20:18 — Debating if Max is Over-Optimistic

1:34:06 — Debating if Corrigibility is the Best Target

1:38:57 — Would Max Work for Anthropic?

1:41:26 — Max’s Modest Hopes

1:58:00 — Max’s New Book: Red Heart

2:16:08 — Outro

Show Notes

Max’s book Red Heart — https://www.amazon.com/Red-Heart-Max-Harms/dp/108822119X

Learn more about CAST: Corrigibility as Singular Target — https://www.lesswrong.com/s/KfCjeconYRdFbMxsy/p/NQK8KHSrZRF5erTba

Max’s Twitter — https://x.com/raelifin

Jeremy’s Twitter — https://x.com/jeremygillen1

---

Doom Debates’ Mission is to raise mainstream awareness of imminent extinction from AGI and build the social infrastructure for high-quality debate.

Support the mission by subscribing to my Substack at DoomDebates.com and to youtube.com/@DoomDebates, or to really take things to the next level: Donate 🙏



Get full access to Doom Debates at lironshapira.substack.com/subscribe
...more
View all episodesView all episodes
Download on the App Store

Doom DebatesBy Liron Shapira

  • 4.3
  • 4.3
  • 4.3
  • 4.3
  • 4.3

4.3

14 ratings


More shows like Doom Debates

View all
Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,320 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,451 Listeners

Robert Wright's Nonzero by Nonzero

Robert Wright's Nonzero

593 Listeners

The Michael Shermer Show by Michael Shermer

The Michael Shermer Show

935 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,178 Listeners

Your Undivided Attention by The Center for Humane Technology, Tristan Harris, Daniel Barcay and Aza Raskin

Your Undivided Attention

1,601 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

95 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

512 Listeners

Theories of Everything with Curt Jaimungal by Theories of Everything

Theories of Everything with Curt Jaimungal

28 Listeners

Razib Khan's Unsupervised Learning by Razib Khan

Razib Khan's Unsupervised Learning

209 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

130 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

227 Listeners

Robinson's Podcast by Robinson Erhardt

Robinson's Podcast

265 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

608 Listeners

The Last Invention by Longview

The Last Invention

1,088 Listeners