The Intuitive Customer - Helping You Improve Your Customer Experience To Gain Growth

5 Rules For Creating Behavioral Experiments That Get Results!


Listen Later

A lot of the behavioral sciences can feel intimidating. However, it doesn’t have to be. The Five Rules Podcast Series is our attempt at giving you an easy entry point into the complex and messy world of Behavioral Science.

Experiments serve as the gold standard for determining causality. If we create them correctly, we know that an action we take makes something else happen and there isn’t any other explanation. 

That is, if we create them correctly.

Even in my corporate career I realized that determining causality is tricky. After presenting to organizations the revenue gains they can expect by taking my advice, they ask, “How do we know that your changes caused the increase instead of something else?” My answer was always the same, unsatisfying one: You won’t.  

That’s because we can never know the causality of behavior at 100 percent certainty (even if we follow all the rules). 

However, when we have more data we also have more confidence that there is no other explanation. Sound experiment creation strategies will help us build a solid case for our causality. 

In this episode, we share the five rules for creating behavioral experiments. We talk about how academics design behavioral experiments and how that could work regarding your experimentation regarding changing experiences to inspire new customer behavior. 

Key Ideas to Improve your Customer Experience

So, what are the 5 rules? The 5 Rules for Running Behavioral Business Experiments include:

  1. Define your metrics and what you're going to measure. 
  2. Establish comparison conditions.
  3. Randomize or get as close to randomization as you possibly can. 
  4. Define the theory…or not.
  5. Foster a culture of experimentation.

Here are a few key moments in the discussion:

  • 03:46  Ryan begins his list of rules by first explaining why you should care about following them, which is because proper experimentation determines causality.
  • 07:43  We get into a discussion about the three things that you need to establish causality in your experiment and why they are important to your results.
  • 10:12 Ryan begins the list of the rules, starting with the most foundational, which is to determine what you want to measure before you design your experiment.    
  • 12:48  We discuss why it is essential to establish different conditions in your experiment (Hint: it comes down to one word: comparison).
  • 20:25  Ryan explains why having a theory going into an experiment than not having one.  
  • 25:42  We talk about why it is essential to allow failure with regards to experiments, and why you will be glad you did (most likely). 

 

Please tell us how we are doing! Complete this short survey. 

Customer Experience Information & Resources

LinkedIn recognizes Colin Shaw as one of the 'World's Top 150 Business Influencers.' As a result, he has 290,000 followers of his work. Shaw is Founder and CEO of Beyond Philosophy LLC, which helps organizations unlock growth by discovering customers' hidden, unmet needs that drive value ($). The Financial Times selected Beyond Philosophy as one of the best management consultancies for the last four years in a row. Follow Colin on LinkedIn and Twitter.

Click here to learn more about Professor Ryan Hamilton of Emory University. 

Why Customers Buy: As an official "Influencer" on LinkedIn, Colin writes a regular newsletter on all things Customer Experience. Click here to join the other 35,000 subscribers. 

How can we help?

Click here to learn more about Beyond Philosophy's Suite of Services.

...more
View all episodesView all episodes
Download on the App Store

The Intuitive Customer - Helping You Improve Your Customer Experience To Gain GrowthBy Colin Shaw, Beyond Philosophy LLC

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

48 ratings


More shows like The Intuitive Customer - Helping You Improve Your Customer Experience To Gain Growth

View all
HBR IdeaCast by Harvard Business Review

HBR IdeaCast

1,855 Listeners

How I Built This with Guy Raz by Guy Raz | Wondery

How I Built This with Guy Raz

30,261 Listeners

Cold Call by HBR Presents / Brian Kenny

Cold Call

191 Listeners

Masters of Scale by WaitWhat

Masters of Scale

3,962 Listeners

Creative Confidence Podcast by IDEO U

Creative Confidence Podcast

127 Listeners

The Diary Of A CEO with Steven Bartlett by DOAC

The Diary Of A CEO with Steven Bartlett

6,742 Listeners

Worklife with Adam Grant by TED

Worklife with Adam Grant

9,259 Listeners

The Best One Yet by Nick & Jack Studios

The Best One Yet

9,557 Listeners

Nudge by Phill Agnew

Nudge

170 Listeners

The Happiness Lab with Dr. Laurie Santos by Pushkin Industries

The Happiness Lab with Dr. Laurie Santos

14,461 Listeners

Think Fast Talk Smart: Communication Techniques by Matt Abrahams, Think Fast Talk Smart

Think Fast Talk Smart: Communication Techniques

776 Listeners

A Bit of Optimism by Simon Sinek

A Bit of Optimism

2,166 Listeners

ReThinking by TED

ReThinking

614 Listeners

How to Age Up by The Atlantic

How to Age Up

1,422 Listeners

HBR On Leadership by Harvard Business Review

HBR On Leadership

148 Listeners