TLDR: InsanityBench is a benchmark of handcrafted cryptic puzzles trying to measure creative conceptual leaps as required in, for example, scientific breakthroughs - SOTA models score around 10% - the benchmark is very much in its earliest form and will need to be properly scaled to reduce variance.

You are given this image and prompted to "solve" it, only left with the title Timely Journey. What are you thinking of?

(In case you genuinely wanna try, stop reading for now, here's the link to the problem)

The domino stones are clearly hinting at 2016 / 4, when they published a different puzzle titled "Long. Journey" which featured coordinates. Just as obvious is that the plant at the top is a Thyme, that you gotta interpret the wooden stone as a Z and there are a bunch of dice showing "ones"; naturally Thyme + Z + ones = Time zones. Of course. And see those pushpins? Yeah, they are pointing at Shift because you have to shift some letters down the line. (It goes on like this but I'll spare you your sanity)

In case it wasn't obvious, I'm being ironic. None of this is obvious - but still weirdly [...]

---

Outline:

(01:33) What is InsanityBench

(02:03) Insanity and Creativity

(03:17) Cant be gamed

(04:31) Nowhere near saturated

(05:31) Details and further plan

---

First published:

Source:

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.