Here’s a cheery one for our first episode of the year. Guess what happens when you give several sets of scientists the same dataset and ask them to answer the same question? Well, they all find the same results, right? Right!?

Sadly not. This “Many Analysts” problem has been analysed and debated in multiple different scientific fields and across several papers. We cover them in this episode. What does it tell us about the objectivity of science if different teams draw different conclusions from the exact same data?

The Science Fictions podcast is brought to you by Works in Progress magazine. Their excellent new article on how we’re living in “the golden age of vaccine development”, as discussed on the show, can be found (along with the rest of their articles on science, history, and technology), at worksinprogress.co. We’re very grateful that they support the podcast.

Show notes

* 2015 Nature commentary article on “crowdsourced research” (on racism in football)

* And the full 2018 writeup titled “Many Analysts, One Data Set”

* Gelman and Loken on the “Garden of Forking Paths”

* 2020 many-analysts neuroscience (fMRI) paper

* And the plan for the similar study on EEG

* 2022 PNAS many-analysts paper on the “hidden universe of uncertainty”

* 2026 critique on ideological bias from George Borjas

* 2023 critique on effect sizes vs. statistical significance

* 2025 ecology & evolution many-analysts paper on blue tits and eucalyptus

* 2025 economics many-analysts paper with results on data cleaning

* 2024 PNAS critique of many-analysts research

* Julia Rohrer’s critique of multiverse analysis

Credits

The Science Fictions podcast is produced by Julian Mayers at Yada Yada Productions.

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit sciencefictionspod.substack.com/subscribe

We’ve covered a lot of bad science stories over the year. Here are a few more. But in the optimistic spirit of the “holiday season”, the last one has a happy ending.

Thanks for listening—especially if you’re a subscriber! See you in 2026.

Stuart & Tom

Show notes

* A surge of low-quality AI papers on public datasets

* A surge of low-quality AI letters to the editor

* Retraction Watch story on the Dana Farber scandal

* NY Times story on the papers being retracted or corrected

* The settlement in the case

Credits

The Science Fictions podcast is produced by Julian Mayers at Yada Yada Productions.

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit sciencefictionspod.substack.com/subscribe

STOP PRESS: a beloved 20th Century populariser of psychology who wrote massively successful books has been shown to be full of crap. Actually… don’t stop press. Just put it on the pile with all the others.

This time it’s Oliver Sacks, the neurologist who wrote The Man Who Mistook his Wife for a Hat, Awakenings, and many other books. An article in The New Yorker has shown that a lot of his case studies were, well… let’s say they’re not what they seem. In this episode we discuss the new article and Oliver Sacks’s career more generally, and ask: should we have known?

The Science Fictions podcast is brought to you by Works in Progress magazine. The article we discussed on today’s show is about the tragically low South Korean birth rate, and why it got that way. Find that, and so many more articles about human progress, science, and technology, at worksinprogress.co.

Show notes

* Rachel Aviv’s December 2025 New Yorker article on Oliver Sacks

* Journal of Autism and Developmental Disorders letter about “questionable aspects” of the autistic savant twins story, by Makoto Yamaguchi

* Follow-up article by the same author

* Response letter by Allan Snyder

* Medical Humanities article on 10 years since Sacks’s death

* Paul McHugh’s 1995 bad review of Sacks’s work

* Science isn’t storytelling

Credits

The Science Fictions podcast is produced by Julian Mayers at Yada Yada Productions.

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit sciencefictionspod.substack.com/subscribe

This is a free preview of a paid episode. To hear more, visit sciencefictionspod.substack.com

Does the evidence support the use of hormone replacement therapy (HRT)? Depends on when you asked the question. At one point the consensus was “yes”; more recently it reversed. But should it have?

It also depends on what symptoms you’re talking about. Is HRT just all about hot flushes, or can it also treat mood and cognitive problems too? In this paid-only episode, we look at the evidence.

To listen to the full episode and read the show notes, please become a paid subscriber to the Science Fictions podcast.

Hello everyone! We weren’t able to record a podcast this week, because 1) Stuart was busy and 2) it’s Tom’s birthday. So by way of apology we’re re-releasing this one about some drama last year between Jon Haidt, sworn enemy of smartphones, and some guys who like meta-analyses. Hope you enjoy it!

A while back, The Studies Show covered the question of whether smartphones and social media cause mental health problems. Amazingly, that podcast didn’t settle the issue, and the debate has continued—and continued rather acrimoniously.

Psychologists—most notably Jonathan Haidt—are currently laying into each other, analysing, re-analysing, and meta-analysing datasets to try and work out whether “it’s the phones”. In this paid-only episode of The Studies Show, Tom and Stuart explain the story so far, and in the process get very disappointed by their heroes.

If you want to hear the whole episode and read the show notes, it’s easy to become a paid subscriber at thestudiesshowpod.com.

Show notes

* The summary of Jonathan Haidt’s upcoming book, Life After Babel

* The Google Doc on social media effects maintained by Haidt, Twenge, and Rausch

* Christopher Ferguson’s meta-analysis of causal social media effects studies

* Very useful online calculator to interpret effect sizes

* Study on the (non-)relation between reported and measured phone use

* Haidt & Rausch’s first article criticising the Ferguson meta-analysis and re-calculating the effects

* Anne Scheel’s critical tweet

* Matt Jané’s first article responding to Haidt & Rausch

* Haidt & Rausch respond to Jané (and criticise Ferguson again)

* Jané responds to Haidt & Rausch, again

* Haidt & Rausch’s second (or is it third?) article criticising the Ferguson meta-analysis (this is the one where they note the more basic errors)

* Article by Mike Males making the point that, whoever is right, the effects are all very small

Credits

* The Studies Show is produced by Julian Mayers at Yada Yada Productions. We’re very grateful to Malte Elson, Pete Etchells, and Matt Jané for talking to us for this episode—but any errors are our own.

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit sciencefictionspod.substack.com/subscribe

Everyone has read Entangled Life, the wonderfully-written book about fungi that took the world by storm about 5 years ago. Among many other things, it popularised the “wood wide web”—the idea that trees can communicate with one another through networks of fungi at their roots.

But is the wood wide web real? It turns out scientists have some major questions. We air them on this episode.

And just to be completely clear, there are no personal vendettas here! Everyone recording this podcast is 100% free of “beefs” of all kinds. Even the co-host who was beaten in a book contest by the aforementioned mushroom book.

The Science Fictions podcast is brought to you by Works in Progress magazine. Their most recent article is about the wonderful invention (and history) of the dishwasher, one of several incredible labour-saving devices that have made so many lives just a bit less dull. Read this, and so many more stories about human progress, at worksinprogress.co.

Show notes

* Entangled Life by Merlin Sheldrake

* Winner of the 2021 Royal Society book award

* Rupert Sheldrake and the concept of “morphic resonance”

* Suzanne Simard’s TED talk about “how trees talk to each other”

* Her 1997 paper on “net transfer of carbon”

* 2023 paper by Karst et al.: “Positive citation bias and overinterpreted results lead to misinformation on common mycorrhizal networks in forests”

* Nature piece following the 2023 paper

* 2015 paper on “stress signaling” via fungal networks

* 2023 paper on tree proximity

* Simard’s response to Karst et al.

Credits

The Science Fictions podcast is produced by Julian Mayers at Yada Yada Productions.

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit sciencefictionspod.substack.com/subscribe

It has happened again. A new paper, based on a tranche of unsealed historical documents, casts serious doubt on a piece of social psychology research from the mid-20th Century. Shocker!

This time it’s about some of the fundamental inspirations for the idea of cognitive dissonance—the idea that holding contradictory views in one’s head creates discomfort and a need to change one of the beliefs. So what does the new historical research say? What about all the studies that claim to find evidence for cognitive dissonance—surely the whole thing isn’t a load of nonsense? Listen to this episode to find out.

The Science Fictions podcast is brought to you by Works in Progress magazine. They’ve recently been publishing a whole host of podcasts, including the one we mentioned this week, on “the economics of the baby bust” (that’s the opposite of a baby boom, by the way). You can find it and many other podcasts at podcast.worksinprogress.co.

Show notes

* The new paper, “Debunking When Prophecy Fails”

* And the related paper “Failed Prophecies are Fatal”

* The lobotomy article in the Washington Post

* Scott Alexander on using facts to persuade

* Dan Engber on the same

* Matti Heino on the original Festinger & Carlsmith (1959) paper

* The paper itself

* The GRIM test (with an online tool to do it yourself)

* 2024 multi-lab replication attempt on cognitive dissonance

* 1983 study that was replicated

Credits

The Science Fictions podcast is produced by Julian Mayers at Yada Yada Productions.

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit sciencefictionspod.substack.com/subscribe

This is a free preview of a paid episode. To hear more, visit sciencefictionspod.substack.com

Creatine is the supplement of the moment, but both of us had vaguely heard that this one might actually not be total garbage.

On the other hand: there are a lot of surprising claims made about it! If proponents are to be believed, it doesn’t just boost muscle mass – it reduces depression, prevents cancer, and improves your cognitive function.

How much of this should we believe, and how much is it just a big load of crap? We thought we would take a look.

Around these parts, we have a tradition to do a paranormal episode at Halloween. We’ve done psychic powers, ghosts, and now… reincarnation. What are we to make of the stories—sometimes told in NYT-bestselling books—of children who appear to remember details of their past lives? What about the many peer-reviewed scientific papers that claim that something supernatural is going on here? In this EXTRA-SPOOKY episode, we find out.

🎃 Happy Halloween! 🎃

The Science Fictions podcast is brought to you by WoooOOOOOooooOOOOorks in ProoooooOOOOOooooooOOOOOooogress magazine, which is bursting with historical stories, policy ideas, and well-written scientific explanations, all focused on the topic of progress. You can find all of Works in Progress—essays, shorter pieces, podcasts, and even the chance to subscribe to the print edition—at worksinprogress.co.

Show notes

* The University of Virginia’s Department of Perceptual Studies

* And the University of Edinburgh’s Koestler Parapsychology Unit

* Jim Tucker, child psychologist and reincarnation researcher

* Tucker’s 2025 paper on the >2,500 reported cases of reincarnation

* 2024 review of cases on the “reincarnation birthmark” issue

* Michael Sudduth’s 94-page debunking of the James Leininger case

* Response from Jim Tucker on Leininger

* Reply from Sudduth

* Sudduth’s blog post on the same issue

* Steven Novella on memory, children’s learning, and supposed reincarnation

Credits

The Science Fictions podcast is produced by Julian Mayers at Yada Yada Productions.

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit sciencefictionspod.substack.com/subscribe

Maybe it’s the most important thing any scientist can study: what makes people happy? The trouble is, despite the importance, a lot of the science on “wellbeing” tends to be very rickety.

But did you know that even one of the best-known findings of wellbeing research—the midlife crisis, or “inverted U shape” of happiness over the lifespan—has been questioned? In this episode we discuss the controversy.

The Science Fictions podcast is brought to you by Works in Progress magazine. At worksinprogress.co you can read issue after issue of fascinating articles bursting with ideas on how humans made scientific and technological progress in the past, and how we can keep it going. You can also check out their selection of other podcasts at podcast.worksinprogress.co.

Show notes

* The American Psychologist paper that claimed to reveal the fluid dynamics of human happiness

* Nick Brown and Alan Sokal’s devastating rebuttal

* And coverage in The Guardian at the time

* David Blanchflower’s original work on the inverted U-shape of happiness

* And subsequent work that backs it up…

* …and subsequent work that does not back it up

* New paper that tries to work out why there are differing results

* Afghanistan reporting the lowest wellbeing in recorded history

* Our previous episode on the weird phenomenon of collider bias

Credits

We’re grateful to Dr. Julia Rohrer of Leipzig University for talking to us for this episode (though as usual, if there are mistakes, they’re ours and not hers). The Science Fictions podcast is produced by Julian Mayers at Yada Yada Productions.

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit sciencefictionspod.substack.com/subscribe