Everything Hertz

25: Misunderstanding p-values

Listen Later

P-values are universal, but do we really know what they mean? In this episode, Dan and James discuss a recent paper describing the failure to correctly interpret p-values in a sample of academic psychologists.

Some of the topics discussed:

  • Common p-value misconceptions
  • James tests Dan on his p-value knowledge
  • p-values vs. effect size
  • The problem of sample size with p-value interpretation
  • The Facebook mood manipulation study
  • Data peeking
  • Equivalent p-values do not represent equivalent results
  • Meta-analytical thinking
  • Using significance as a categorical factor
  • Statistical vs. clinical significance
  • Clinical trial registration and 'secondary outcome creep'
  • Dan and James answer listener questions
  • Science communicator vs. scientist
  • Grant titles and the 'Pub test'
  • NASA and social media

    • Links

    • The article

      • http://journal.frontiersin.org/article/10.3389/fpsyg.2016.01247/full

      • Geoff Cumming's book (we got the name completely wrong - sorry Geoff!)

        • http://www.amazon.com/Understanding-The-New-Statistics-Meta-Analysis-ebook/dp/B007M9D76G/ref=pd_sim_kstore_1?ie=UTF8&refRID=1QWKES82EP85DBAEKNT1

        The story on research passing the 'pub' test

        https://theconversation.com/if-youre-going-to-ridicule-research-do-your-homework-64238

        Real scientists

        http://realscientists.org

        Facebook page

        https://www.facebook.com/everythinghertzpodcast/

        Twitter account

        https://www.twitter.com

        Support Everything Hertz

        ...more
        View all episodesView all episodes
        Download on the App Store
        Everything HertzBy Dan Quintana
        • 4.8
        • 4.8
        • 4.8
        • 4.8
        • 4.8

        4.8

        55 ratings

        More shows like Everything Hertz

        View all
        Philosophy Bites by Edmonds and Warburton

        Philosophy Bites

        1,532 Listeners

        Very Bad Wizards by Tamler Sommers & David Pizarro

        Very Bad Wizards

        2,652 Listeners

        The Gist by Peach Fish Productions

        The Gist

        59 Listeners

        Barbell Medicine Podcast by Barbell Medicine

        Barbell Medicine Podcast

        1,157 Listeners

        Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

        Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

        4,119 Listeners

        Iron Culture presented by MASS by Eric Helms & Eric Trexler

        Iron Culture presented by MASS

        723 Listeners

        Within Reason by Alex J O'Connor

        Within Reason

        1,566 Listeners

        Tech Won't Save Us by Paris Marx

        Tech Won't Save Us

        531 Listeners

        Deep Questions with Cal Newport by Cal Newport

        Deep Questions with Cal Newport

        1,306 Listeners

        Decoding the Gurus by Christopher Kavanagh and Matthew Browne

        Decoding the Gurus

        946 Listeners

        Clearer Thinking with Spencer Greenberg by Spencer Greenberg

        Clearer Thinking with Spencer Greenberg

        132 Listeners

        The Ezra Klein Show by New York Times Opinion

        The Ezra Klein Show

        15,405 Listeners

        The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

        The Joy of Why

        500 Listeners

        Nullius in Verba by Smriti Mehta and Daniël Lakens

        Nullius in Verba

        10 Listeners

        The 404 Media Podcast by 404 Media

        The 404 Media Podcast

        312 Listeners