LessWrong (30+ Karma)

“GPT-4o Sycophancy Post Mortem” by Zvi


Listen Later

Last week I covered that GPT-4o was briefly an (even more than usually) absurd sycophant, and how OpenAI responded to that.

Their explanation at that time was paper thin. It didn’t tell us much that we did not already know, and seemed to suggest they had learned little from the incident.

Rolling Stone has a write-up of some of the people whose delusions got reinforced by ChatGPT, which has been going on for a while – this sycophancy incident made things way worse but the pattern isn’t new. Here's some highlights, but the whole thing is wild anecdotes throughout, and they point to a ChatGPT induced psychosis thread on Reddit. I would love to know how often this actually happens.

Table of Contents

  1. There's An Explanation For (Some Of) This.
  2. What Have We Learned?
  3. What About o3 The Lying Liar?
  4. o3 [...]
  5. ---

    Outline:

    (00:51) There's An Explanation For (Some Of) This

    (02:50) What Have We Learned?

    (10:09) What About o3 The Lying Liar?

    (12:21) o3 The Source Fabricator

    (14:25) There Is Still A Lot We Don't Know

    (20:43) You Must Understand The Logos

    (25:17) Circling Back

    (28:11) The Good News

    ---

    First published:

    May 5th, 2025

    Source:

    https://www.lesswrong.com/posts/KyndnEA7NMFrDKtJG/gpt-4o-sycophancy-post-mortem

    ---

    Narrated by TYPE III AUDIO.

    ---

    Images from the article:

    Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

    ...more
    View all episodesView all episodes
    Download on the App Store

    LessWrong (30+ Karma)By LessWrong


    More shows like LessWrong (30+ Karma)

    View all
    The Daily by The New York Times

    The Daily

    112,234 Listeners

    Astral Codex Ten Podcast by Jeremiah

    Astral Codex Ten Podcast

    131 Listeners

    Interesting Times with Ross Douthat by New York Times Opinion

    Interesting Times with Ross Douthat

    7,230 Listeners

    Dwarkesh Podcast by Dwarkesh Patel

    Dwarkesh Podcast

    562 Listeners

    The Ezra Klein Show by New York Times Opinion

    The Ezra Klein Show

    16,230 Listeners

    AI Article Readings by Readings of great articles in AI voices

    AI Article Readings

    4 Listeners

    Doom Debates! by Liron Shapira

    Doom Debates!

    14 Listeners

    LessWrong posts by zvi by zvi

    LessWrong posts by zvi

    2 Listeners