LessWrong (30+ Karma)

“AI Companion Piece” by Zvi


Listen Later

AI companions, other forms of personalized AI content and persuasion and related issues continue to be a hot topic. What do people use companions for? Are we headed for a goonpocalypse? Mostly no, companions are used mostly not used for romantic relationships or erotica, although perhaps that could change. How worried should we be about personalization maximized for persuasion or engagement?

Table of Contents

  1. Persuasion Should Be In Your Preparedness Framework.
  2. Personalization By Default Gets Used To Maximize Engagement.
  3. Companion.
  4. Goonpocalypse Now.
  5. Deepfaketown and Botpocalypse Soon.
  6. Persuasion Should Be In Your Preparedness Framework

    Kobi Hackenburg leads on the latest paper on AI persuasion.
    Kobi Hackenberg: RESULTS (pp = percentage points):
    1⃣Scale increases persuasion, +1.6pp per OOM
    2⃣Post-training more so, +3.5pp
    3⃣Personalization less so, <1pp
    4⃣Information density drives persuasion gains
    5⃣Increasing persuasion decreased factual accuracy
    6⃣Convo > static, +40%
    Zero is on [...]

    ---

    Outline:

    (00:35) Persuasion Should Be In Your Preparedness Framework

    (04:33) Personalization By Default Gets Used To Maximize Engagement

    (13:04) Companion

    (16:50) Goonpocalypse Now

    (24:09) Deepfaketown and Botpocalypse Soon

    ---

    First published:

    July 28th, 2025

    Source:

    https://www.lesswrong.com/posts/Rm3FD6646NDSCGxqM/ai-companion-piece

    ---

    Narrated by TYPE III AUDIO.

    ---

    Images from the article:

    Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    ...more
    View all episodesView all episodes
    Download on the App Store

    LessWrong (30+ Karma)By LessWrong


    More shows like LessWrong (30+ Karma)

    View all
    The Daily by The New York Times

    The Daily

    112,284 Listeners

    Astral Codex Ten Podcast by Jeremiah

    Astral Codex Ten Podcast

    131 Listeners

    Interesting Times with Ross Douthat by New York Times Opinion

    Interesting Times with Ross Douthat

    7,232 Listeners

    Dwarkesh Podcast by Dwarkesh Patel

    Dwarkesh Podcast

    557 Listeners

    The Ezra Klein Show by New York Times Opinion

    The Ezra Klein Show

    16,236 Listeners

    AI Article Readings by Readings of great articles in AI voices

    AI Article Readings

    4 Listeners

    Doom Debates! by Liron Shapira

    Doom Debates!

    14 Listeners

    LessWrong posts by zvi by zvi

    LessWrong posts by zvi

    2 Listeners