Everything Hertz

52: Give p's a chance (with Daniel Lakens)

Listen Later

In this episode, Dan and James welcome back Daniel Lakens (Eindhoven University of Technology) to discuss his new paper on justifying your alpha level.

Highlights:

  • Why did Daniel write this paper?
  • Turning away from mindless statistics
  • Incremental vs. seismic change in statistical practice
  • The limitations to justifying your alpha
  • The benefits of registered reports
  • Daniel’s coursera course
  • What’s better? Two pre-registered studies at .05 or one unregistered study at .005?
  • Testing at the start of semester vs. the end of semester
  • Thinking of controlling for Type 1 errors as driving speed limits
  • Error rates mean different things between fields
  • What if we applied the “5 Sigma” threshold used in physics to the biobehavioral sciences?
  • What about abandoning statistical significance
  • How did Daniel co-ordinate a paper with 88 co-authors?
  • Using time zones to your benefit when collaborating
  • How can junior researchers contribute to these types of discussions?
  • Science by discussion, not manifesto
  • The dangers of blanket recommendations
  • How do you actually justify your alpha from scratch?

    • Links

    Daniel on Twitter - https://www.twitter.com/lakens

    Daniel’s courser course - https://www.coursera.org/learn/statistical-inferences
    Justify your alpha paper - https://psyarxiv.com/9s3y6
    Abandon statistical significance - https://arxiv.org/abs/1709.07588
    Using the costs of error rates to set your alpha - https://doi.org/10.1111/j.1461-0248.2004.00625.x

    Special Guest: Daniel Lakens.

    Support Everything Hertz

    ...more
    View all episodesView all episodes
    Download on the App Store
    Everything HertzBy Dan Quintana
    • 4.8
    • 4.8
    • 4.8
    • 4.8
    • 4.8

    4.8

    55 ratings

    More shows like Everything Hertz

    View all
    Philosophy Bites by Edmonds and Warburton

    Philosophy Bites

    1,534 Listeners

    Very Bad Wizards by Tamler Sommers & David Pizarro

    Very Bad Wizards

    2,653 Listeners

    The Gist by Peach Fish Productions

    The Gist

    62 Listeners

    Barbell Medicine Podcast by Barbell Medicine

    Barbell Medicine Podcast

    1,157 Listeners

    Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

    Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

    4,119 Listeners

    Iron Culture presented by MASS by Eric Helms & Eric Trexler

    Iron Culture presented by MASS

    723 Listeners

    Within Reason by Alex J O'Connor

    Within Reason

    1,560 Listeners

    Tech Won't Save Us by Paris Marx

    Tech Won't Save Us

    532 Listeners

    Deep Questions with Cal Newport by Cal Newport

    Deep Questions with Cal Newport

    1,301 Listeners

    Decoding the Gurus by Christopher Kavanagh and Matthew Browne

    Decoding the Gurus

    941 Listeners

    Clearer Thinking with Spencer Greenberg by Spencer Greenberg

    Clearer Thinking with Spencer Greenberg

    131 Listeners

    The Ezra Klein Show by New York Times Opinion

    The Ezra Klein Show

    15,410 Listeners

    The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

    The Joy of Why

    500 Listeners

    Nullius in Verba by Smriti Mehta and Daniël Lakens

    Nullius in Verba

    10 Listeners

    The 404 Media Podcast by 404 Media

    The 404 Media Podcast

    312 Listeners