LessWrong (Curated & Popular)

"Personality Self-Replicators" by eggsyntax


Listen Later

One-sentence summary

I describe the risk of personality self-replicators, the threat of OpenClaw-like agents managing to spread in hard-to-control ways.

Summary

LLM agents like OpenClaw are defined by a small set of text files and run in an open source framework which leverages LLMs for cognition. It is quite difficult for current frontier models to self-replicate, it is much easier for such agents (at the cost of greater reliance on external agents). While not a likely existential threat, such agents may cause harm in similar ways to computer viruses, and be similarly challenging to shut down. Once such a threat emerges, evolutionary dynamics could cause it to escalate quickly. Relevant organizations should consider this threat and consider how they should respond when and if it materializes.

Background

Starting in late January, there's been an intense wave of interest in a vibecoded open source agent called OpenClaw (fka moltbot, clawdbot) and Moltbook, a supposed social network for such agents. There's been a thick fog of war surrounding Moltbook especially: it's been hard to tell where individual posts fall on the spectrum from faked-by-humans to strongly-prompted-by-humans to approximately-spontaneous.

I won't try to detail all the ins and outs of OpenClaw and [...]

---

Outline:

(00:09) One-sentence summary

(00:21) Summary

(01:02) Background

(02:29) The threat model

(05:29) Threat level

(05:56) Feasibility of self-replication

(08:27) Difficulty of shutdown

(11:27) Potential harm

(13:19) Evolutionary concern

(14:33) Useful points of comparison

(15:59) Recommendations

(16:03) Evals

(17:11) Preparation

(18:40) Conclusion

(19:15) Appendix: related work

(21:40) Acknowledgments

The original text contained 11 footnotes which were omitted from this narration.

---

First published:
March 5th, 2026

Source:
https://www.lesswrong.com/posts/fGpQ4cmWsXo2WWeyn/personality-self-replicators

---



Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

...more
View all episodesView all episodes
Download on the App Store

LessWrong (Curated & Popular)By LessWrong

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

12 ratings


More shows like LessWrong (Curated & Popular)

View all
Macro Voices by Hedge Fund Manager Erik Townsend

Macro Voices

3,072 Listeners

Odd Lots by Bloomberg

Odd Lots

1,993 Listeners

EconTalk by Russ Roberts

EconTalk

4,270 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,461 Listeners

Philosophy Bites by Edmonds and Warburton

Philosophy Bites

1,532 Listeners

ChinaTalk by Jordan Schneider

ChinaTalk

291 Listeners

ManifoldOne by Steve Hsu

ManifoldOne

97 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

101 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

551 Listeners

Clearer Thinking with Spencer Greenberg by Spencer Greenberg

Clearer Thinking with Spencer Greenberg

137 Listeners

Razib Khan's Unsupervised Learning by Razib Khan

Razib Khan's Unsupervised Learning

208 Listeners

"Econ 102" with Noah Smith and Erik Torenberg by Turpentine

"Econ 102" with Noah Smith and Erik Torenberg

147 Listeners

Money Stuff: The Podcast by Bloomberg

Money Stuff: The Podcast

403 Listeners

Complex Systems with Patrick McKenzie (patio11) by Patrick McKenzie

Complex Systems with Patrick McKenzie (patio11)

143 Listeners

The Marginal Revolution Podcast by Mercatus Center at George Mason University

The Marginal Revolution Podcast

91 Listeners