LessWrong posts by zvi

“AI Companion Piece” by Zvi


Listen Later

AI companions, other forms of personalized AI content and persuasion and related issues continue to be a hot topic. What do people use companions for? Are we headed for a goonpocalypse? Mostly no, companions are used mostly not used for romantic relationships or erotica, although perhaps that could change. How worried should we be about personalization maximized for persuasion or engagement?

Table of Contents

  1. Persuasion Should Be In Your Preparedness Framework.
  2. Personalization By Default Gets Used To Maximize Engagement.
  3. Companion.
  4. Goonpocalypse Now.
  5. Deepfaketown and Botpocalypse Soon.
  6. Persuasion Should Be In Your Preparedness Framework

    Kobi Hackenburg leads on the latest paper on AI persuasion.
    Kobi Hackenberg: RESULTS (pp = percentage points):
    1⃣Scale increases persuasion, +1.6pp per OOM
    2⃣Post-training more so, +3.5pp
    3⃣Personalization less so, <1pp
    4⃣Information density drives persuasion gains
    5⃣Increasing persuasion decreased factual accuracy
    6⃣Convo > static, +40%
    Zero is on [...]

    ---

    Outline:

    (00:35) Persuasion Should Be In Your Preparedness Framework

    (04:33) Personalization By Default Gets Used To Maximize Engagement

    (13:04) Companion

    (16:50) Goonpocalypse Now

    (24:09) Deepfaketown and Botpocalypse Soon

    ---

    First published:

    July 28th, 2025

    Source:

    https://www.lesswrong.com/posts/Rm3FD6646NDSCGxqM/ai-companion-piece

    ---

    Narrated by TYPE III AUDIO.

    ---

    Images from the article:

    Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    ...more
    View all episodesView all episodes
    Download on the App Store

    LessWrong posts by zviBy zvi

    • 5
    • 5
    • 5
    • 5
    • 5

    5

    2 ratings


    More shows like LessWrong posts by zvi

    View all
    Making Sense with Sam Harris by Sam Harris

    Making Sense with Sam Harris

    26,387 Listeners

    Conversations with Tyler by Mercatus Center at George Mason University

    Conversations with Tyler

    2,423 Listeners

    a16z Podcast by Andreessen Horowitz

    a16z Podcast

    1,081 Listeners

    Future of Life Institute Podcast by Future of Life Institute

    Future of Life Institute Podcast

    107 Listeners

    ChinaTalk by Jordan Schneider

    ChinaTalk

    289 Listeners

    Politix by Politix

    Politix

    93 Listeners

    Dwarkesh Podcast by Dwarkesh Patel

    Dwarkesh Podcast

    489 Listeners

    Hard Fork by The New York Times

    Hard Fork

    5,470 Listeners

    Clearer Thinking with Spencer Greenberg by Spencer Greenberg

    Clearer Thinking with Spencer Greenberg

    132 Listeners

    LessWrong (Curated & Popular) by LessWrong

    LessWrong (Curated & Popular)

    13 Listeners

    No Priors: Artificial Intelligence | Technology | Startups by Conviction

    No Priors: Artificial Intelligence | Technology | Startups

    133 Listeners

    "Econ 102" with Noah Smith and Erik Torenberg by Turpentine

    "Econ 102" with Noah Smith and Erik Torenberg

    151 Listeners

    BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

    BG2Pod with Brad Gerstner and Bill Gurley

    508 Listeners

    LessWrong (30+ Karma) by LessWrong

    LessWrong (30+ Karma)

    0 Listeners

    Complex Systems with Patrick McKenzie (patio11) by Patrick McKenzie

    Complex Systems with Patrick McKenzie (patio11)

    133 Listeners