
Sign up to save your podcasts
Or


A/B testing used to mean picking two options, splitting your audience, and waiting weeks for results. AI just changed the rules — now you can test a thousand variants simultaneously while you sleep. But faster testing comes with a hidden danger: AI will optimize for the wrong thing if you let it.
In this episode, Jill breaks down how multi-armed bandits, AI-generated variants, and real-time significance testing are transforming how travel brands — from cruise lines to theme parks — design better experiences. Plus, she shares a three-question framework you can paste directly into AI before any test to make sure you're optimizing for what actually matters.
Because AI runs the test. You ask the question. Don't mix those up.
By JillA/B testing used to mean picking two options, splitting your audience, and waiting weeks for results. AI just changed the rules — now you can test a thousand variants simultaneously while you sleep. But faster testing comes with a hidden danger: AI will optimize for the wrong thing if you let it.
In this episode, Jill breaks down how multi-armed bandits, AI-generated variants, and real-time significance testing are transforming how travel brands — from cruise lines to theme parks — design better experiences. Plus, she shares a three-question framework you can paste directly into AI before any test to make sure you're optimizing for what actually matters.
Because AI runs the test. You ask the question. Don't mix those up.