Everything Hertz

36: Statistical inconsistencies in published research

Listen Later

In episode 34 we covered a blog post that highlighted questionable analytical approaches in psychology. That post mentioned four studies that resulted from this approach, which a team of researchers took a closer look into. Dan and James discuss the statistical inconsistencies that the authors reported in a recent preprint.

Some of the topics covered:

  • Trump (of course)
  • A summary of the preprint
  • The GRIM test to detect inconsistencies
  • The researchers that accidently administered the equivalent of 300 cups of coffee to study participants
  • How do we prevent inconsistent reporting?
  • 21 word solution for research transparency
  • Journals mandating statistical inconsistency checks, such as 'statcheck'

    • Links

    The pre-print

    https://peerj.com/preprints/2748/

    'The grad student that didn't say no' blog post

    http://www.brianwansink.com/phd-advice/the-grad-student-who-never-said-no

    The caffeine study

    http://www.bbc.com/news/uk-england-tyne-38744307

    Tobacco and Alcohol Research Group lab handbook (see page 6 for open science practices)

    http://www.bris.ac.uk/media-library/sites/expsych/documents/targ/TARG%20Handbook%20161128.pdf

    21 word solution

    http://spsp.org/sites/default/files/dialogue_26(2).pdf

    Facebook page

    https://www.facebook.com/everythinghertzpodcast/

    Twitter account

    https://www.twitter.com/hertzpodcast

    Support Everything Hertz

    ...more
    View all episodesView all episodes
    Download on the App Store
    Everything HertzBy Dan Quintana
    • 4.8
    • 4.8
    • 4.8
    • 4.8
    • 4.8

    4.8

    55 ratings

    More shows like Everything Hertz

    View all
    Freakonomics Radio by Freakonomics Radio + Stitcher

    Freakonomics Radio

    32,239 Listeners

    The LRB Podcast by The London Review of Books

    The LRB Podcast

    314 Listeners

    On the Media by WNYC Studios

    On the Media

    9,243 Listeners

    More or Less by BBC Radio 4

    More or Less

    864 Listeners

    Page 94: The Private Eye Podcast by Page 94: The Private Eye Podcast

    Page 94: The Private Eye Podcast

    428 Listeners

    Football Weekly by The Guardian

    Football Weekly

    2,544 Listeners

    The Daily by The New York Times

    The Daily

    113,272 Listeners

    Behind the Bastards by Cool Zone Media and iHeartPodcasts

    Behind the Bastards

    15,691 Listeners

    Two Psychologists Four Beers by Yoel Inbar, Michael Inzlicht, and Alexa Tullett

    Two Psychologists Four Beers

    159 Listeners

    Front Burner by CBC

    Front Burner

    458 Listeners

    Today in Focus by The Guardian

    Today in Focus

    1,008 Listeners

    The Rest Is History by Goalhanger

    The Rest Is History

    15,491 Listeners

    The Ezra Klein Show by New York Times Opinion

    The Ezra Klein Show

    16,489 Listeners

    The Rest Is Politics by Goalhanger

    The Rest Is Politics

    3,925 Listeners

    Nullius in Verba by Smriti Mehta and Daniël Lakens

    Nullius in Verba

    13 Listeners