Sign up to save your podcasts
Or
Share #43- AI Hype Vs Real-World Medicine
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
#43- AI Hype Vs Real-World Medicine
What if the headline “AI outperformed doctors” is asking the wrong question? When a Harvard emergency triage study makes waves, it’s easy to focus on the most dramatic takeaway. But the real story is more complicated: what did the study actually test, and what parts of emergency medicine did it leave out?
We slow down the hype and take a closer look at what AI can and cannot tell us about clinical decision-making. We unpack how today’s AI excitement fits into a much longer history of bold promises, from the early optimism of the Dartmouth Conference to modern “AI summers” driven by funding, media attention, and novelty. They also explore what an “AI winter” really means, why confidence can collapse quickly, and how today’s ecosystem makes exaggeration easier to spread and harder to correct.
Then we turn to the realities of emergency care. ER triage is not about guessing one diagnosis or producing a neat top-five list. It is about urgency, risk, and judgment under uncertainty: identifying life-threatening possibilities, deciding what tests come next, and determining who needs immediate care, admission, or safe discharge. The conversation also highlights a major limitation of text-only AI evaluations: medical charts are already shaped by human clinicians, meaning the model may be relying on information that required real-world expertise to gather in the first place.
For anyone interested in trustworthy AI in healthcare, medical diagnosis, health misinformation, and the responsible use of large language models in clinical settings, this episode offers a clearer way to think beyond the headline.
References:
Performance of a large language model on the reasoning tasks of a physician
Brodeur et al.
Science (2026)
Did AI really beat ER doctors at ER triage?
Nope. A look at an interesting AI study that has led to some very overhyped headlines.
Kristen Panthagani
You can know Things, Substack (2026)
Credits:
Theme music: Nowhere Land, Kevin MacLeod (incompetech.com)
Licensed under Creative Commons: By Attribution 4.0
https://creativecommons.org/licenses/by/4.0/
View all episodes
By Vasanth Sarathy & Laura HagopianWhat if the headline “AI outperformed doctors” is asking the wrong question? When a Harvard emergency triage study makes waves, it’s easy to focus on the most dramatic takeaway. But the real story is more complicated: what did the study actually test, and what parts of emergency medicine did it leave out?
We slow down the hype and take a closer look at what AI can and cannot tell us about clinical decision-making. We unpack how today’s AI excitement fits into a much longer history of bold promises, from the early optimism of the Dartmouth Conference to modern “AI summers” driven by funding, media attention, and novelty. They also explore what an “AI winter” really means, why confidence can collapse quickly, and how today’s ecosystem makes exaggeration easier to spread and harder to correct.
Then we turn to the realities of emergency care. ER triage is not about guessing one diagnosis or producing a neat top-five list. It is about urgency, risk, and judgment under uncertainty: identifying life-threatening possibilities, deciding what tests come next, and determining who needs immediate care, admission, or safe discharge. The conversation also highlights a major limitation of text-only AI evaluations: medical charts are already shaped by human clinicians, meaning the model may be relying on information that required real-world expertise to gather in the first place.
For anyone interested in trustworthy AI in healthcare, medical diagnosis, health misinformation, and the responsible use of large language models in clinical settings, this episode offers a clearer way to think beyond the headline.
References:
Performance of a large language model on the reasoning tasks of a physician
Brodeur et al.
Science (2026)
Did AI really beat ER doctors at ER triage?
Nope. A look at an interesting AI study that has led to some very overhyped headlines.
Kristen Panthagani
You can know Things, Substack (2026)
Credits:
Theme music: Nowhere Land, Kevin MacLeod (incompetech.com)
Licensed under Creative Commons: By Attribution 4.0
https://creativecommons.org/licenses/by/4.0/