Sign up to save your podcasts
Or
Share “AI Companion Piece” by Zvi
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
“AI Companion Piece” by Zvi
AI companions, other forms of personalized AI content and persuasion and related issues continue to be a hot topic. What do people use companions for? Are we headed for a goonpocalypse? Mostly no, companions are used mostly not used for romantic relationships or erotica, although perhaps that could change. How worried should we be about personalization maximized for persuasion or engagement?
Table of Contents
Persuasion Should Be In Your Preparedness Framework
Kobi Hackenburg leads on the latest paper on AI persuasion.
Kobi Hackenberg: RESULTS (pp = percentage points):
1⃣Scale increases persuasion, +1.6pp per OOM
2⃣Post-training more so, +3.5pp
3⃣Personalization less so, <1pp
4⃣Information density drives persuasion gains
5⃣Increasing persuasion decreased factual accuracy
6⃣Convo > static, +40%
Zero is on [...]
---
Outline:
(00:35) Persuasion Should Be In Your Preparedness Framework
(04:33) Personalization By Default Gets Used To Maximize Engagement
(13:04) Companion
(16:50) Goonpocalypse Now
(24:09) Deepfaketown and Botpocalypse Soon
---
First published:
July 28th, 2025
Source:
https://www.lesswrong.com/posts/Rm3FD6646NDSCGxqM/ai-companion-piece
---
Narrated by TYPE III AUDIO.
---
Images from the article:
Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
View all episodes
By LessWrongAI companions, other forms of personalized AI content and persuasion and related issues continue to be a hot topic. What do people use companions for? Are we headed for a goonpocalypse? Mostly no, companions are used mostly not used for romantic relationships or erotica, although perhaps that could change. How worried should we be about personalization maximized for persuasion or engagement?
Table of Contents
Persuasion Should Be In Your Preparedness Framework
Kobi Hackenburg leads on the latest paper on AI persuasion.
Kobi Hackenberg: RESULTS (pp = percentage points):
1⃣Scale increases persuasion, +1.6pp per OOM
2⃣Post-training more so, +3.5pp
3⃣Personalization less so, <1pp
4⃣Information density drives persuasion gains
5⃣Increasing persuasion decreased factual accuracy
6⃣Convo > static, +40%
Zero is on [...]
---
Outline:
(00:35) Persuasion Should Be In Your Preparedness Framework
(04:33) Personalization By Default Gets Used To Maximize Engagement
(13:04) Companion
(16:50) Goonpocalypse Now
(24:09) Deepfaketown and Botpocalypse Soon
---
First published:
July 28th, 2025
Source:
https://www.lesswrong.com/posts/Rm3FD6646NDSCGxqM/ai-companion-piece
---
Narrated by TYPE III AUDIO.
---
Images from the article:
Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
More shows like LessWrong (30+ Karma)
View all
Making Sense with Sam Harris
26,375 Listeners
Conversations with Tyler
2,424 Listeners
The Peter Attia Drive
8,934 Listeners
Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas
4,153 Listeners
ManifoldOne
92 Listeners
Your Undivided Attention
1,594 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
9,907 Listeners
Machine Learning Street Talk (MLST)
90 Listeners
Dwarkesh Podcast
75 Listeners
Hard Fork
5,469 Listeners
The Ezra Klein Show
16,043 Listeners
Moonshots with Peter Diamandis
539 Listeners
No Priors: Artificial Intelligence | Technology | Startups
130 Listeners
Latent Space: The AI Engineer Podcast
95 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
503 Listeners