Astral Codex Ten Podcast

Nostalgebraist's Hydrogen Jukeboxes


Listen Later

In conclusion, the only good theory of taste is Nostalgebraist's.

He wrote a post called Hydrogen Jukeboxes, analyzing the literary output of an AI called R1. This AI tried hard to write good fiction, which was part of the problem. It crammed its stories with what Nostalgebraist called (stealing a term from Ginsberg) the "eyeball kick" - a flashy stylistic move that immediately catches the reader's attention and "wows" them. Here are examples - some from R1, others from an experimental OpenAI model trained specifically for fiction-writing:

  • "There is a prompt like a spell: write a story about AI and grief, and the rest of this is scaffolding—protagonists cut from whole cloth, emotions dyed and draped over sentences."
  • "When the jar of Sam's laughter shattered, Eli found the sound pooled on the floorboards like liquid amber, thick and slow. It had been their best summer, that laughter—ripe with fireflies and porch wine—now seeping into the cracks, fermenting."
  • "And so I built a Mila and a Kai and a field of marigolds that never existed. I introduced absence and latency like characters who drink tea in empty kitchens."
  • "The morning her shadow began unspooling from her feet, Clara found it coiled beneath the kitchen table like a serpent made of smoke."

Nostalgebraist and another writer, Coagulopath, catalogue some of the most common AI eyeball kicks, each occurring across multiple LLM models:

  • "An overwhelming reliance on cliche. Everything is a shadow, an echo, a whisper, a void, a heartbeat, a pulse, a river, a flower—you see it spinning its Rolodex of 20-30 generic images and selecting one at random."
  • "Conjunctions combining one thing that is abstract and/or incorporeal with another thing that is concrete and/or sensory."
  • "Repetitive writing. Once you've seen about ten R1 samples you can recognize its style on sight. The way it italicises the last word of a sentence. Its endless "not thing x, but thing y" parallelisms…the way how, if you don't like a story, it's almost pointless reprompting it: you just get the same stuff again, smeared around your plate a bit."

https://www.astralcodexten.com/p/nostalgebraists-hydrogen-jukeboxes

...more
View all episodesView all episodes
Download on the App Store

Astral Codex Ten PodcastBy Jeremiah

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

129 ratings


More shows like Astral Codex Ten Podcast

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,110 Listeners

The Partially Examined Life Philosophy Podcast by Mark Linsenmayer, Wes Alwan, Seth Paskin, Dylan Casey

The Partially Examined Life Philosophy Podcast

2,116 Listeners

Very Bad Wizards by Tamler Sommers & David Pizarro

Very Bad Wizards

2,672 Listeners

Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,254 Listeners

EconTalk by Russ Roberts

EconTalk

4,270 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,448 Listeners

The Glenn Show by Glenn Loury

The Glenn Show

2,271 Listeners

The Good Fight by Yascha Mounk

The Good Fight

890 Listeners

ChinaTalk by Jordan Schneider

ChinaTalk

292 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,168 Listeners

Your Undivided Attention by The Center for Humane Technology, Tristan Harris, Aza Raskin

Your Undivided Attention

1,625 Listeners

Last Week in AI by Skynet Today

Last Week in AI

316 Listeners

Blocked and Reported by Katie Herzog and Jesse Singal

Blocked and Reported

3,819 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

577 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

691 Listeners