Design and Travel

AI-Powered A/B Testing: Optimize Faster, But Ask Better Questions


Listen Later

A/B testing used to mean picking two options, splitting your audience, and waiting weeks for results. AI just changed the rules — now you can test a thousand variants simultaneously while you sleep. But faster testing comes with a hidden danger: AI will optimize for the wrong thing if you let it.

In this episode, Jill breaks down how multi-armed bandits, AI-generated variants, and real-time significance testing are transforming how travel brands — from cruise lines to theme parks — design better experiences. Plus, she shares a three-question framework you can paste directly into AI before any test to make sure you're optimizing for what actually matters.

Because AI runs the test. You ask the question. Don't mix those up.

  • What A/B testing actually is (and why people overcomplicate it)
  • 3 ways AI has upgraded the testing process
  • Real travel industry examples: cruise bookings, airline fees, theme park notifications
  • Why a higher click-through rate can be a trap
  • A copy-paste AI prompt for better test design in 30 seconds
...more
View all episodesView all episodes
Download on the App Store

Design and TravelBy Jill