Everything Hertz

25: Misunderstanding p-values

Listen Later

P-values are universal, but do we really know what they mean? In this episode, Dan and James discuss a recent paper describing the failure to correctly interpret p-values in a sample of academic psychologists.

Some of the topics discussed:

  • Common p-value misconceptions
  • James tests Dan on his p-value knowledge
  • p-values vs. effect size
  • The problem of sample size with p-value interpretation
  • The Facebook mood manipulation study
  • Data peeking
  • Equivalent p-values do not represent equivalent results
  • Meta-analytical thinking
  • Using significance as a categorical factor
  • Statistical vs. clinical significance
  • Clinical trial registration and 'secondary outcome creep'
  • Dan and James answer listener questions
  • Science communicator vs. scientist
  • Grant titles and the 'Pub test'
  • NASA and social media

    • Links

    • The article

      • http://journal.frontiersin.org/article/10.3389/fpsyg.2016.01247/full

      • Geoff Cumming's book (we got the name completely wrong - sorry Geoff!)

        • http://www.amazon.com/Understanding-The-New-Statistics-Meta-Analysis-ebook/dp/B007M9D76G/ref=pd_sim_kstore_1?ie=UTF8&refRID=1QWKES82EP85DBAEKNT1

        The story on research passing the 'pub' test

        https://theconversation.com/if-youre-going-to-ridicule-research-do-your-homework-64238

        Real scientists

        http://realscientists.org

        Facebook page

        https://www.facebook.com/everythinghertzpodcast/

        Twitter account

        https://www.twitter.com

        Support Everything Hertz

        ...more
        View all episodesView all episodes
        Download on the App Store
        Everything HertzBy Dan Quintana
        • 4.8
        • 4.8
        • 4.8
        • 4.8
        • 4.8

        4.8

        55 ratings

        More shows like Everything Hertz

        View all
        The Gist by Peach Fish Productions

        The Gist

        3,631 Listeners

        Very Bad Wizards by Tamler Sommers & David Pizarro

        Very Bad Wizards

        2,674 Listeners

        Philosophy Bites by Edmonds and Warburton

        Philosophy Bites

        1,544 Listeners

        Barbell Medicine Podcast by Barbell Medicine

        Barbell Medicine Podcast

        1,193 Listeners

        Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

        Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

        4,176 Listeners

        Iron Culture presented by MASS by Eric Helms & Eric Trexler

        Iron Culture presented by MASS

        733 Listeners

        Within Reason by Alex J O'Connor

        Within Reason

        1,659 Listeners

        Tech Won't Save Us by Paris Marx

        Tech Won't Save Us

        576 Listeners

        Deep Questions with Cal Newport by Cal Newport

        Deep Questions with Cal Newport

        1,340 Listeners

        Decoding the Gurus by Christopher Kavanagh and Matthew Browne

        Decoding the Gurus

        957 Listeners

        Clearer Thinking with Spencer Greenberg by Spencer Greenberg

        Clearer Thinking with Spencer Greenberg

        142 Listeners

        The Ezra Klein Show by New York Times Opinion

        The Ezra Klein Show

        16,096 Listeners

        The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

        The Joy of Why

        489 Listeners

        Nullius in Verba by Smriti Mehta and Daniël Lakens

        Nullius in Verba

        10 Listeners

        The 404 Media Podcast by 404 Media

        The 404 Media Podcast

        389 Listeners