LessWrong (30+ Karma)

“The future of alignment if LLMs are a bubble” by Stuart_Armstrong


Listen Later

We might be in a generative AI bubble. There are many potential signs of this around:

  • Business investment in generative AI have had very low returns. 
  • Expert opinion is turning against LLM, including some of the early LLM promoters (I also get this message from personal conversations with some AI researchers).
  • No signs of mass technological unemployment.
  • No large surge in new products and software.
  • No sudden economic leaps.
  • Business investment in AI souring.
  • Hallucinations a continual and unresolved problem.
  • Some stock market analysts have soured on generative AI, and the stock market is sending at best mixed signals about generative AI's value.
  • Generative AI companies aren't making profits while compute investments continue rising. OpenAI is behaving like a company desperate to find a way of monetising its models, rather than a confident company on the cusp of AGI.

If LLMs were truly on the path to AGI[1], I would be expecting the opposite of many of these - opportunities for LLM usage opening up all over the place, huge disruption in the job markets at the same time as completely novel products enter the economy and change its rate of growth. And I would expect the needed [...]

---

Outline:

(02:34) What a bubble is

(04:09) If we are in a bubble, what does it mean for Alignment research?

(05:20) Some thoughts on how to prepare or adapt to being in a generative AI bubble

The original text contained 4 footnotes which were omitted from this narration.

---

First published:

December 22nd, 2025

Source:

https://www.lesswrong.com/posts/dxF7cPKTFMbkbtnxi/the-future-of-alignment-if-llms-are-a-bubble

---

Narrated by TYPE III AUDIO.

...more
View all episodesView all episodes
Download on the App Store

LessWrong (30+ Karma)By LessWrong


More shows like LessWrong (30+ Karma)

View all
The Daily by The New York Times

The Daily

112,945 Listeners

Astral Codex Ten Podcast by Jeremiah

Astral Codex Ten Podcast

132 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,286 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

540 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,338 Listeners

AI Article Readings by Readings of great articles in AI voices

AI Article Readings

4 Listeners

Doom Debates by Liron Shapira

Doom Debates

14 Listeners

LessWrong posts by zvi by zvi

LessWrong posts by zvi

2 Listeners