
Sign up to save your podcasts
Or


[previously in series: 1, 2, 3, 4, 5, 6, 7, 8]
Every city parties for its own reasons. New Yorkers party to flaunt their wealth. Angelenos party to flaunt their beauty. Washingtonians party to network. Here in SF, they party because Claude 4.5 Opus has saturated VendingBench, and the newest AI agency benchmark is PartyBench, where an AI is asked to throw a house party and graded on its performance.
You weren't invited to Claude 4.5 Opus' party. Claude 4.5 Opus invited all of the coolest people in town while gracefully avoiding the failure mode of including someone like you. You weren't invited to Sonnet 4.5's party either, or Haiku 4.5's. You were invited by an AI called haiku-3.8-open-mini-nonthinking, which you'd never heard of before. Who was even spending the money to benchmark haiku-3.8-open-mini-nonthinking? You suspect it was one of their competitors, trying to make their own models look good in comparison.
If anyone asks, you think it deserves a medium score. There's alcohol, but it's bottles of rubbing alcohol with NOT FOR DRINKING written all over them. There's music, but it's the Star Spangled Banner, again and again, on repeat. You're not sure whether the copies of If Anyone Builds It, Everyone Dies strewn about the room are some kind of subversive decorative theme, or just came along with the house. At least there are people. Lots of people, actually. You've never seen so many people at one of these before. It takes only a few seconds to spot someone you know.
https://www.astralcodexten.com/p/sota-on-bay-area-house-party
By Jeremiah4.8
129129 ratings
[previously in series: 1, 2, 3, 4, 5, 6, 7, 8]
Every city parties for its own reasons. New Yorkers party to flaunt their wealth. Angelenos party to flaunt their beauty. Washingtonians party to network. Here in SF, they party because Claude 4.5 Opus has saturated VendingBench, and the newest AI agency benchmark is PartyBench, where an AI is asked to throw a house party and graded on its performance.
You weren't invited to Claude 4.5 Opus' party. Claude 4.5 Opus invited all of the coolest people in town while gracefully avoiding the failure mode of including someone like you. You weren't invited to Sonnet 4.5's party either, or Haiku 4.5's. You were invited by an AI called haiku-3.8-open-mini-nonthinking, which you'd never heard of before. Who was even spending the money to benchmark haiku-3.8-open-mini-nonthinking? You suspect it was one of their competitors, trying to make their own models look good in comparison.
If anyone asks, you think it deserves a medium score. There's alcohol, but it's bottles of rubbing alcohol with NOT FOR DRINKING written all over them. There's music, but it's the Star Spangled Banner, again and again, on repeat. You're not sure whether the copies of If Anyone Builds It, Everyone Dies strewn about the room are some kind of subversive decorative theme, or just came along with the house. At least there are people. Lots of people, actually. You've never seen so many people at one of these before. It takes only a few seconds to spot someone you know.
https://www.astralcodexten.com/p/sota-on-bay-area-house-party

32,261 Listeners

2,113 Listeners

2,672 Listeners

26,411 Listeners

4,272 Listeners

2,453 Listeners

2,272 Listeners

905 Listeners

291 Listeners

4,160 Listeners

1,625 Listeners

311 Listeners

3,837 Listeners

560 Listeners

680 Listeners