Everything Hertz

25: Misunderstanding p-values

Listen Later

P-values are universal, but do we really know what they mean? In this episode, Dan and James discuss a recent paper describing the failure to correctly interpret p-values in a sample of academic psychologists.

Some of the topics discussed:

  • Common p-value misconceptions
  • James tests Dan on his p-value knowledge
  • p-values vs. effect size
  • The problem of sample size with p-value interpretation
  • The Facebook mood manipulation study
  • Data peeking
  • Equivalent p-values do not represent equivalent results
  • Meta-analytical thinking
  • Using significance as a categorical factor
  • Statistical vs. clinical significance
  • Clinical trial registration and 'secondary outcome creep'
  • Dan and James answer listener questions
  • Science communicator vs. scientist
  • Grant titles and the 'Pub test'
  • NASA and social media

    • Links

    • The article

      • http://journal.frontiersin.org/article/10.3389/fpsyg.2016.01247/full

      • Geoff Cumming's book (we got the name completely wrong - sorry Geoff!)

        • http://www.amazon.com/Understanding-The-New-Statistics-Meta-Analysis-ebook/dp/B007M9D76G/ref=pd_sim_kstore_1?ie=UTF8&refRID=1QWKES82EP85DBAEKNT1

        The story on research passing the 'pub' test

        https://theconversation.com/if-youre-going-to-ridicule-research-do-your-homework-64238

        Real scientists

        http://realscientists.org

        Facebook page

        https://www.facebook.com/everythinghertzpodcast/

        Twitter account

        https://www.twitter.com

        Support Everything Hertz

        ...more
        View all episodesView all episodes
        Download on the App Store
        Everything HertzBy Dan Quintana
        • 4.8
        • 4.8
        • 4.8
        • 4.8
        • 4.8

        4.8

        55 ratings

        More shows like Everything Hertz

        View all
        Freakonomics Radio by Freakonomics Radio + Stitcher

        Freakonomics Radio

        32,250 Listeners

        The LRB Podcast by The London Review of Books

        The LRB Podcast

        314 Listeners

        On the Media by WNYC Studios

        On the Media

        9,239 Listeners

        More or Less by BBC Radio 4

        More or Less

        863 Listeners

        Page 94: The Private Eye Podcast by Page 94: The Private Eye Podcast

        Page 94: The Private Eye Podcast

        425 Listeners

        Football Weekly by The Guardian

        Football Weekly

        2,545 Listeners

        The Daily by The New York Times

        The Daily

        113,307 Listeners

        Behind the Bastards by Cool Zone Media and iHeartPodcasts

        Behind the Bastards

        15,689 Listeners

        Two Psychologists Four Beers by Yoel Inbar, Michael Inzlicht, and Alexa Tullett

        Two Psychologists Four Beers

        159 Listeners

        Front Burner by CBC

        Front Burner

        457 Listeners

        Today in Focus by The Guardian

        Today in Focus

        1,013 Listeners

        The Rest Is History by Goalhanger

        The Rest Is History

        15,506 Listeners

        The Ezra Klein Show by New York Times Opinion

        The Ezra Klein Show

        16,508 Listeners

        The Rest Is Politics by Goalhanger

        The Rest Is Politics

        3,915 Listeners

        Nullius in Verba by Smriti Mehta and Daniël Lakens

        Nullius in Verba

        13 Listeners