Astral Codex Ten Podcast

My AI Opinions


Listen Later

I recently had a minor spat over someone misinterpreting my AI beliefs (see section marked "Update" at the bottom here), so I thought I would list them in one place, so I can refer people when they ask.

Timelines1

Define AGI as AI intelligent enough to do 90% of knowledge work jobs. I think there's a 25% chance of AGI by 20272, a 50% chance by 2034, and a 75% chance by 2045.

Basic argument: In a certain sense, AI is already "smart" enough for this (eg it can answer quantum physics problems, which require higher IQ than most knowledge work). Its remaining limitations are that it's confused, unagentic, lacks situational awareness, and tends to hallucinate. The METR time horizon graph, and several other related benchmarks/experiments/intuition pumps, suggest it's improving on time horizons at an (exponential) rate that lets it cross human-level performance sometime around the early end of the schedule above, and subjectively it feels like harder-to-measure constructs like situational awareness are improving about as fast.

Arguments for earlier: recursive self-improvement causes a speedup compared to the trend. This is one of the biggest blank spots in my model: I don't know how fast RSI will progress, and I don't think anyone else does either. There's some function mapping a combination of AI talent and compute to progress, and we don't know how it behaves in the domain when there's far more talent than compute available. It could fizzle out completely for lack of compute, or it could go vertical. The AI Futures Project has done some of the best work trying to model this, but even they have low confidence.

...more
View all episodesView all episodes
Download on the App Store

Astral Codex Ten PodcastBy Jeremiah

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

129 ratings


More shows like Astral Codex Ten Podcast

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,100 Listeners

The Partially Examined Life Philosophy Podcast by Mark Linsenmayer, Wes Alwan, Seth Paskin, Dylan Casey

The Partially Examined Life Philosophy Podcast

2,117 Listeners

Very Bad Wizards by Tamler Sommers & David Pizarro

Very Bad Wizards

2,675 Listeners

Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,250 Listeners

EconTalk by Russ Roberts

EconTalk

4,272 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,447 Listeners

The Glenn Show by Glenn Loury

The Glenn Show

2,271 Listeners

The Good Fight by Yascha Mounk

The Good Fight

893 Listeners

ChinaTalk by Jordan Schneider

ChinaTalk

292 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,170 Listeners

Your Undivided Attention by The Center for Humane Technology, Tristan Harris, Aza Raskin

Your Undivided Attention

1,627 Listeners

Last Week in AI by Skynet Today

Last Week in AI

314 Listeners

Blocked and Reported by Katie Herzog and Jesse Singal

Blocked and Reported

3,820 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

576 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

682 Listeners