The Black Goat

Does Not Compute


Listen Later

Scientific journal articles have a lot of numbers. Scientists are smart people with even smarter computers, so an outsider might think that, if nothing else, you can count on the math checking out. But modern data analysis is complicated, and computational reproducibility is far from guaranteed. In this episode, we discuss a recent set of articles published at the journal Cortex. A group of authors set out to replicate an influential 2010 article that claimed that if you reactivate a fear-laden memory, it becomes possible to change the emotional association - something with clear relevance to clinical practice. Along the way, the replicating scientists encountered anomalies which led them to try to reproduce the analyses in the original study - and they discovered that they could not. We talk about what this means for science. What are the implications of knowing that for a nontrivial number if scientific studies, the math doesn't add up? Will a new era of open data and open code be enough to fix the problem? How much will Verification Reports - a new publication format that Cortex has introduced - help with that process? Plus: We answer a letter about swinging for the fences when your dream job comes up but you don't feel ready yet.

Links:

  • The three R's of scientific integrity: Replicability, reproducibility, and robustness, by Robert McIntosh and Chris Chambers
  • The Validity of the Tool “statcheck” in Discovering Statistical Reporting Inconsistencies, by Michèle Nuijten et al
  • Analytic reproducibility in articles receiving open data badges at Psychological Science: An observational study, by Tom Hardwicke et al
  • The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire. Find us on the web at www.theblackgoatpodcast.com, on Twitter at @blackgoatpod, on Facebook at facebook.com/blackgoatpod/, and on instagram at @blackgoatpod. You can email us at [email protected]. You can subscribe to us on iTunes or Stitcher.

     

    Our theme music is Peak Beak by Doctor Turtle, available on freemusicarchive.org under a Creative Commons noncommercial attribution license. Our logo was created by Jude Weaver.

     

    This is episode 82. It was recorded on August 10, 2020.

    ...more
    View all episodesView all episodes
    Download on the App Store

    The Black GoatBy Sanjay Srivastava, Alexa Tullett, and Simine Vazire

    • 4.7
    • 4.7
    • 4.7
    • 4.7
    • 4.7

    4.7

    98 ratings


    More shows like The Black Goat

    View all
    Psychology in Everyday Life: The Psych Files by Michael Britt

    Psychology in Everyday Life: The Psych Files

    291 Listeners

    Philosophy Bites by Edmonds and Warburton

    Philosophy Bites

    1,537 Listeners

    In Our Time: Philosophy by BBC Radio 4

    In Our Time: Philosophy

    854 Listeners

    Very Bad Wizards by Tamler Sommers & David Pizarro

    Very Bad Wizards

    2,657 Listeners

    Philosophize This! by Stephen West

    Philosophize This!

    15,120 Listeners

    Speaking of Psychology by American Psychological Association

    Speaking of Psychology

    55 Listeners

    The Psychology Podcast by iHeartPodcasts

    The Psychology Podcast

    1,838 Listeners

    Hidden Brain by Hidden Brain, Shankar Vedantam

    Hidden Brain

    43,744 Listeners

    Therapist Uncensored Podcast by Sue Marriott LCSW, CGP & Ann Kelley PhD

    Therapist Uncensored Podcast

    1,385 Listeners

    Ologies with Alie Ward by Alie Ward

    Ologies with Alie Ward

    24,045 Listeners

    This Jungian Life Podcast by Joseph Lee, Deborah Stewart, Lisa Marchiano

    This Jungian Life Podcast

    1,580 Listeners

    The Weirdest Thing I Learned This Week by Popular Science

    The Weirdest Thing I Learned This Week

    2,174 Listeners

    Conspirituality by Derek Beres, Matthew Remski, Julian Walker

    Conspirituality

    1,998 Listeners

    Overthink by Ellie Anderson, Ph.D. and David Peña-Guzmán, Ph.D.

    Overthink

    417 Listeners

    Waking Up to Narcissism by Tony Overbay LMFT

    Waking Up to Narcissism

    676 Listeners