LessWrong (30+ Karma)

“Don’t use the phrase “human values”” by Nina Panickssery


Listen Later

I really dislike the phrase "human values". I think it's confusing because:

  • It obscures a distinction between human preferences and normative values, i.e. what the author thinks is good in a moral sense
    • Insofar as the author thinks that fulfilling human preferences is good, they often leave this unjustified
  • It's unclear who the "human" in "human values" is. Is it...
    • The person using the phrase "human values"
    • Any particular single individual
    • Most humans
    • Certain humans
    • Humans as they will be in the future, or after "reflection"
  • It's often used with an unjustified implicit assumption, like:
    • Humans will eventually converge on deciding to value to same stuff, provided enough time/intelligence/information
    • What most/some humans value must be objectively good to pursue
      • Because they have intuitive access to moral truths, or
      • Because of an ethical framework that necessitates this like preference utilitarianism
    • Most humans already value the same stuff

Instead of "human values", people should either:

  • Talk about someone's preferences
    • Their own preferences
    • The preferences most / some people share
    • The preferences they / some / most people would have after reflecting
    • A special type of subset of those preferences (e.g. preferences that stay [...]

---

First published:

November 15th, 2025

Source:

https://www.lesswrong.com/posts/dyDpJyNLgAHTAHeX9/don-t-use-the-phrase-human-values

---

Narrated by TYPE III AUDIO.

...more
View all episodesView all episodes
Download on the App Store

LessWrong (30+ Karma)By LessWrong


More shows like LessWrong (30+ Karma)

View all
The Daily by The New York Times

The Daily

112,956 Listeners

Astral Codex Ten Podcast by Jeremiah

Astral Codex Ten Podcast

132 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,290 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

548 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,362 Listeners

AI Article Readings by Readings of great articles in AI voices

AI Article Readings

4 Listeners

Doom Debates by Liron Shapira

Doom Debates

14 Listeners

LessWrong posts by zvi by zvi

LessWrong posts by zvi

2 Listeners