Normal Curves: Sexy Science, Serious Statistics

Holiday Survival Guide Part 2: The survey study edition


Listen Later

Does the temperature of your coffee six months ago really predict whether you feel gassy today? This week we dissect a new nutrition survey study on hot and cold beverage habits that claims to connect drink temperature with gut symptoms, anxiety, and more—despite relying on year-old memories and a blizzard of statistical tests. It’s the perfect case study for our Holiday Survival Guide Part 2, where we teach you how to talk with Uncle Joe at the dinner table about one of the most common—and most fraught—study designs in science: cross-sectional surveys. We walk through our easy checklist for making sense of results, show how recall bias and measurement error can skew the story, and reacquaint you with nonmonogamous Multiple-Testing Dude, who’s been very busy in this dataset. A friendly, practical guide to spotting when researchers are just torturing the data until it confesses.


Statistical topics

  • Confounding
  • Cross-sectional studies
  • False positives
  • Measurement error
  • Multiple testing
  • PICOT / PIVOT framework
  • Recall bias
  • Research hypotheses
  • Sample size and power
  • Signal vs. noise
  • SMART framework
  • Statistical significance
  • Subgroup analyses
  • Survey design
  • Transparency and trustworthiness


Methodological morals

  • “When your measurement starts with ‘think back to last winter’ you might as well use a random number generator.”
  • “If the effect is only significant in certain subgroups in certain seasons for certain outcomes, it might just be a bad case of gas.”



References

  • Wu T, Doyle C, Ito J, et al. Cold Exposures in Relation to Dysmenorrhea among Asian and White Women. Int J Environ Res Public Health. 2023;21(1):56. Published 2023 Dec 30. doi:10.3390/ijerph21010056
  • Wu T, Ramesh N, Doyle C, Hsu FC. Cold and hot consumption and health outcomes among US Asian and White populations. Br J Nutr. Published online September 18, 2025. doi:10.1017/S000711452510514X



Kristin and Regina’s online courses: 

Demystifying Data: A Modern Approach to Statistical Understanding  

Clinical Trials: Design, Strategy, and Analysis 

Medical Statistics Certificate Program  

Writing in the Sciences 

Epidemiology and Clinical Research Graduate Certificate Program 

Programs that we teach in:

Epidemiology and Clinical Research Graduate Certificate Program 


Find us on:

Kristin -  LinkedIn & Twitter/X

Regina - LinkedIn & ReginaNuzzo.com


  • (00:00) - Intro
  • (04:36) - Did they have real research hypotheses?
  • (10:29) - Observational or randomized experiment?
  • (20:09) - PICOT and PIVOT
  • (26:20) - Memory problems
  • (32:03) - Five outcomes and measurement problems therein
  • (36:56) - SMART
  • (41:50) - Multiple Testing Dude is having a great time
  • (52:36) - How big is the effect?
  • (59:06) - Wrap-up and Irish Coffee rating scale

  • ...more
    View all episodesView all episodes
    Download on the App Store

    Normal Curves: Sexy Science, Serious StatisticsBy Regina Nuzzo and Kristin Sainani

    • 4.9
    • 4.9
    • 4.9
    • 4.9
    • 4.9

    4.9

    32 ratings


    More shows like Normal Curves: Sexy Science, Serious Statistics

    View all
    More or Less by BBC Radio 4

    More or Less

    890 Listeners

    Science Weekly by The Guardian

    Science Weekly

    427 Listeners

    Newscast by BBC News

    Newscast

    643 Listeners

    Today in Focus by The Guardian

    Today in Focus

    984 Listeners

    The Happiness Lab: Getting Unstuck by Pushkin Industries

    The Happiness Lab: Getting Unstuck

    14,346 Listeners

    Cautionary Tales with Tim Harford by Pushkin Industries

    Cautionary Tales with Tim Harford

    5,151 Listeners

    Poetry Unbound by On Being Studios

    Poetry Unbound

    3,591 Listeners

    ReThinking by TED

    ReThinking

    636 Listeners

    The Rest Is Politics by Goalhanger

    The Rest Is Politics

    3,075 Listeners

    Politics Weekly America by The Guardian

    Politics Weekly America

    207 Listeners

    ZOE Science & Nutrition by ZOE

    ZOE Science & Nutrition

    2,137 Listeners

    The News Agents by Global

    The News Agents

    991 Listeners

    The Rest Is Entertainment by Goalhanger

    The Rest Is Entertainment

    870 Listeners

    The Louis Theroux Podcast by Spotify Studios

    The Louis Theroux Podcast

    374 Listeners

    Strangers on a Bench by Tom Rosenthal

    Strangers on a Bench

    723 Listeners