Everything Hertz

36: Statistical inconsistencies in published research

Listen Later

In episode 34 we covered a blog post that highlighted questionable analytical approaches in psychology. That post mentioned four studies that resulted from this approach, which a team of researchers took a closer look into. Dan and James discuss the statistical inconsistencies that the authors reported in a recent preprint.

Some of the topics covered:

  • Trump (of course)
  • A summary of the preprint
  • The GRIM test to detect inconsistencies
  • The researchers that accidently administered the equivalent of 300 cups of coffee to study participants
  • How do we prevent inconsistent reporting?
  • 21 word solution for research transparency
  • Journals mandating statistical inconsistency checks, such as 'statcheck'

    • Links

    The pre-print

    https://peerj.com/preprints/2748/

    'The grad student that didn't say no' blog post

    http://www.brianwansink.com/phd-advice/the-grad-student-who-never-said-no

    The caffeine study

    http://www.bbc.com/news/uk-england-tyne-38744307

    Tobacco and Alcohol Research Group lab handbook (see page 6 for open science practices)

    http://www.bris.ac.uk/media-library/sites/expsych/documents/targ/TARG%20Handbook%20161128.pdf

    21 word solution

    http://spsp.org/sites/default/files/dialogue_26(2).pdf

    Facebook page

    https://www.facebook.com/everythinghertzpodcast/

    Twitter account

    https://www.twitter.com/hertzpodcast

    Support Everything Hertz

    ...more
    View all episodesView all episodes
    Download on the App Store
    Everything HertzBy Dan Quintana
    • 4.8
    • 4.8
    • 4.8
    • 4.8
    • 4.8

    4.8

    55 ratings

    More shows like Everything Hertz

    View all
    Philosophy Bites by Edmonds and Warburton

    Philosophy Bites

    1,534 Listeners

    Very Bad Wizards by Tamler Sommers & David Pizarro

    Very Bad Wizards

    2,652 Listeners

    The Gist by Peach Fish Productions

    The Gist

    61 Listeners

    Barbell Medicine Podcast by Barbell Medicine

    Barbell Medicine Podcast

    1,157 Listeners

    Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

    Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

    4,119 Listeners

    Iron Culture presented by MASS by Eric Helms & Eric Trexler

    Iron Culture presented by MASS

    723 Listeners

    Within Reason by Alex J O'Connor

    Within Reason

    1,559 Listeners

    Tech Won't Save Us by Paris Marx

    Tech Won't Save Us

    532 Listeners

    Deep Questions with Cal Newport by Cal Newport

    Deep Questions with Cal Newport

    1,302 Listeners

    Decoding the Gurus by Christopher Kavanagh and Matthew Browne

    Decoding the Gurus

    941 Listeners

    Clearer Thinking with Spencer Greenberg by Spencer Greenberg

    Clearer Thinking with Spencer Greenberg

    129 Listeners

    The Ezra Klein Show by New York Times Opinion

    The Ezra Klein Show

    15,433 Listeners

    The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

    The Joy of Why

    501 Listeners

    Nullius in Verba by Smriti Mehta and Daniël Lakens

    Nullius in Verba

    10 Listeners

    The 404 Media Podcast by 404 Media

    The 404 Media Podcast

    312 Listeners