Jeff Bezos famously said not to overthink decisions you can just undo. But what if rolling back a change doesn't actually roll anything back?
Tom and Corissa explore what can happen when you stack "reversible" experiments until the whole system collapses—from Facebook's slow degradation to an apocryphal Tesco story where undoing an experiment didn't fix what got broken.
Along the way: sand pile criticality that can't be predicted, seaside penny waterfalls that cascade unpredictably, and why "safe-to-fail probes" might need a rebrand (spoiler: aliens).
Including but not limited to:
● The grain of sand you can't predict—and why that matters for your business experiments
● When Subway cancelled unlimited salad and what it has in common with private equity acquisitions
● The Tesco experiment that broke the camel's back
● Throwing gravel from a boat in a storm
● Three of the requirements for truly safe-to-fail experiments (and why most companies miss all three)
● Boops vs. probes: finding language for experimentation that doesn't sound like something unpleasant that happens during an alien abduction
This one goes out to all our friends who suspect their "data-driven" culture is just pretending to control things it can't.
References:
● Jeff Bezos (Come on Jeff, get 'em!) – two-way door decisions concept
● Heraclitus – "you can't step in the same river twice"
● Sand pile and criticality (mathematical concept)
● The Sorites Paradox – when does some sand become a pile of sand?
● Enshittification – term and concept from Cory Doctorow
● Rory Sutherland – restaurant story about private equity "meaner" portions
● Tesco AB testing story (flagged as potentially apocryphal)
● Dave Snowden – Cynefin framework and safe-to-fail probes
● Path dependency (mentioned as topic of previous episode)
● North Star metrics
● Andrew Anderson – obliquely referenced in context of experimentation https://testingdiscipline.com/
Questions, stories, or better names for "safe-to-fail boops"? Email us: [email protected]
Find out more about us and our work at crownandreach.com
Hosted on Acast. See acast.com/privacy for more information.