The Black Goat

Does Not Compute


Listen Later

Scientific journal articles have a lot of numbers. Scientists are smart people with even smarter computers, so an outsider might think that, if nothing else, you can count on the math checking out. But modern data analysis is complicated, and computational reproducibility is far from guaranteed. In this episode, we discuss a recent set of articles published at the journal Cortex. A group of authors set out to replicate an influential 2010 article that claimed that if you reactivate a fear-laden memory, it becomes possible to change the emotional association - something with clear relevance to clinical practice. Along the way, the replicating scientists encountered anomalies which led them to try to reproduce the analyses in the original study - and they discovered that they could not. We talk about what this means for science. What are the implications of knowing that for a nontrivial number if scientific studies, the math doesn't add up? Will a new era of open data and open code be enough to fix the problem? How much will Verification Reports - a new publication format that Cortex has introduced - help with that process? Plus: We answer a letter about swinging for the fences when your dream job comes up but you don't feel ready yet.

Links:

  • The three R's of scientific integrity: Replicability, reproducibility, and robustness, by Robert McIntosh and Chris Chambers
  • The Validity of the Tool “statcheck” in Discovering Statistical Reporting Inconsistencies, by Michèle Nuijten et al
  • Analytic reproducibility in articles receiving open data badges at Psychological Science: An observational study, by Tom Hardwicke et al
  • The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire. Find us on the web at www.theblackgoatpodcast.com, on Twitter at @blackgoatpod, on Facebook at facebook.com/blackgoatpod/, and on instagram at @blackgoatpod. You can email us at [email protected]. You can subscribe to us on iTunes or Stitcher.

     

    Our theme music is Peak Beak by Doctor Turtle, available on freemusicarchive.org under a Creative Commons noncommercial attribution license. Our logo was created by Jude Weaver.

     

    This is episode 82. It was recorded on August 10, 2020.

    ...more
    View all episodesView all episodes
    Download on the App Store

    The Black GoatBy Sanjay Srivastava, Alexa Tullett, and Simine Vazire

    • 4.7
    • 4.7
    • 4.7
    • 4.7
    • 4.7

    4.7

    98 ratings


    More shows like The Black Goat

    View all
    Psychology in Everyday Life: The Psych Files by Michael Britt

    Psychology in Everyday Life: The Psych Files

    289 Listeners

    Philosophy Bites by Edmonds and Warburton

    Philosophy Bites

    1,532 Listeners

    In Our Time: Philosophy by BBC Radio 4

    In Our Time: Philosophy

    866 Listeners

    Very Bad Wizards by Tamler Sommers & David Pizarro

    Very Bad Wizards

    2,656 Listeners

    Philosophize This! by Stephen West

    Philosophize This!

    15,093 Listeners

    Speaking of Psychology by American Psychological Association

    Speaking of Psychology

    50 Listeners

    The Psychology Podcast by iHeartPodcasts

    The Psychology Podcast

    1,831 Listeners

    Hidden Brain by Hidden Brain, Shankar Vedantam

    Hidden Brain

    43,483 Listeners

    Therapist Uncensored Podcast by Sue Marriott LCSW, CGP & Ann Kelley PhD

    Therapist Uncensored Podcast

    1,388 Listeners

    Ologies with Alie Ward by Alie Ward

    Ologies with Alie Ward

    23,778 Listeners

    This Jungian Life Podcast by Joseph Lee, Deborah Stewart, Lisa Marchiano

    This Jungian Life Podcast

    1,569 Listeners

    The Weirdest Thing I Learned This Week by Popular Science

    The Weirdest Thing I Learned This Week

    2,160 Listeners

    Conspirituality by Derek Beres, Matthew Remski, Julian Walker

    Conspirituality

    1,986 Listeners

    Overthink by Ellie Anderson, Ph.D. and David Peña-Guzmán, Ph.D.

    Overthink

    417 Listeners

    Waking Up to Narcissism by Tony Overbay LMFT

    Waking Up to Narcissism

    676 Listeners