Your Undivided Attention

Daniel Kokotajlo Forecasts the End of Human Dominance


Listen Later

In 2023, researcher Daniel Kokotajlo left OpenAI—and risked millions in stock options—to warn the world about the dangerous direction of AI development. Now he’s out with AI 2027, a forecast of where that direction might take us in the very near future. 

AI 2027 predicts a world where humans lose control over our destiny at the hands of misaligned, super-intelligent AI systems within just the next few years. That may sound like science fiction but when you’re living on the upward slope of an exponential curve, science fiction can quickly become all too real. And you don’t have to agree with Daniel’s specific forecast to recognize that the incentives around AI could take us to a very bad place.

We invited Daniel on the show this week to discuss those incentives, how they shape the outcomes he predicts in AI 2027, and what concrete steps we can take today to help prevent those outcomes.  

Your Undivided Attention is produced by the Center for Humane Technology. Follow us on X: @HumaneTech_. You can find a full transcript, key takeaways, and much more on our Substack.

RECOMMENDED MEDIA
The AI 2027 forecast from the AI Futures Project

Daniel’s original AI 2026 blog post 

Further reading on Daniel’s departure from OpenAI

Anthropic recently released a survey of all the recent emergent misalignment research

Our statement in support of Sen. Grassley’s AI Whistleblower bill 

RECOMMENDED YUA EPISODES

The Narrow Path: Sam Hammond on AI, Institutions, and the Fragile Future
AGI Beyond the Buzz: What Is It, and Are We Ready?

Behind the DeepSeek Hype, AI is Learning to Reason
The Self-Preserving Machine: Why AI Learns to Deceive

Clarification: Daniel K. referred to whistleblower protections that apply when companies “break promises” or “mislead the public.” There are no specific private sector whistleblower protections that use these standards. In almost every case, a specific law has to have been broken to trigger whistleblower protections.


 

...more
View all episodesView all episodes
Download on the App Store

Your Undivided AttentionBy Tristan Harris and Aza Raskin, The Center for Humane Technology

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

1,446 ratings


More shows like Your Undivided Attention

View all
On Being with Krista Tippett by On Being Studios

On Being with Krista Tippett

10,295 Listeners

Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,328 Listeners

Hidden Brain by Hidden Brain, Shankar Vedantam

Hidden Brain

43,334 Listeners

The Gray Area with Sean Illing by Vox

The Gray Area with Sean Illing

10,661 Listeners

Team Human by Douglas Rushkoff

Team Human

361 Listeners

Future of Life Institute Podcast by Future of Life Institute

Future of Life Institute Podcast

108 Listeners

The Michael Shermer Show by Michael Shermer

The Michael Shermer Show

913 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,119 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

6,955 Listeners

Andrew Yang Podcast by Andrew Yang & Audacy

Andrew Yang Podcast

3,186 Listeners

Deep Questions with Cal Newport by Cal Newport

Deep Questions with Cal Newport

1,301 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

425 Listeners

Hard Fork by The New York Times

Hard Fork

5,462 Listeners

Clearer Thinking with Spencer Greenberg by Spencer Greenberg

Clearer Thinking with Spencer Greenberg

131 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

15,410 Listeners