Everything Hertz

36: Statistical inconsistencies in published research

Listen Later

In episode 34 we covered a blog post that highlighted questionable analytical approaches in psychology. That post mentioned four studies that resulted from this approach, which a team of researchers took a closer look into. Dan and James discuss the statistical inconsistencies that the authors reported in a recent preprint.

Some of the topics covered:

  • Trump (of course)
  • A summary of the preprint
  • The GRIM test to detect inconsistencies
  • The researchers that accidently administered the equivalent of 300 cups of coffee to study participants
  • How do we prevent inconsistent reporting?
  • 21 word solution for research transparency
  • Journals mandating statistical inconsistency checks, such as 'statcheck'

    • Links

    The pre-print

    https://peerj.com/preprints/2748/

    'The grad student that didn't say no' blog post

    http://www.brianwansink.com/phd-advice/the-grad-student-who-never-said-no

    The caffeine study

    http://www.bbc.com/news/uk-england-tyne-38744307

    Tobacco and Alcohol Research Group lab handbook (see page 6 for open science practices)

    http://www.bris.ac.uk/media-library/sites/expsych/documents/targ/TARG%20Handbook%20161128.pdf

    21 word solution

    http://spsp.org/sites/default/files/dialogue_26(2).pdf

    Facebook page

    https://www.facebook.com/everythinghertzpodcast/

    Twitter account

    https://www.twitter.com/hertzpodcast

    Support Everything Hertz

    ...more
    View all episodesView all episodes
    Download on the App Store
    Everything HertzBy Dan Quintana
    • 4.8
    • 4.8
    • 4.8
    • 4.8
    • 4.8

    4.8

    55 ratings

    More shows like Everything Hertz

    View all
    Freakonomics Radio by Freakonomics Radio + Stitcher

    Freakonomics Radio

    32,100 Listeners

    The LRB Podcast by The London Review of Books

    The LRB Podcast

    301 Listeners

    On the Media by WNYC Studios

    On the Media

    9,237 Listeners

    More or Less by BBC Radio 4

    More or Less

    876 Listeners

    Page 94: The Private Eye Podcast by Page 94: The Private Eye Podcast

    Page 94: The Private Eye Podcast

    393 Listeners

    Football Weekly by The Guardian

    Football Weekly

    2,599 Listeners

    The Daily by The New York Times

    The Daily

    111,948 Listeners

    Behind the Bastards by Cool Zone Media and iHeartPodcasts

    Behind the Bastards

    15,655 Listeners

    Two Psychologists Four Beers by Yoel Inbar, Michael Inzlicht, and Alexa Tullett

    Two Psychologists Four Beers

    156 Listeners

    Front Burner by CBC

    Front Burner

    419 Listeners

    Today in Focus by The Guardian

    Today in Focus

    986 Listeners

    The Rest Is History by Goalhanger

    The Rest Is History

    15,592 Listeners

    The Ezra Klein Show by New York Times Opinion

    The Ezra Klein Show

    15,950 Listeners

    The Rest Is Politics by Goalhanger

    The Rest Is Politics

    3,336 Listeners

    Nullius in Verba by Smriti Mehta and Daniël Lakens

    Nullius in Verba

    12 Listeners