Health Data Ethics

Health Data Ethics

Download on the App Store

Health Data Ethics episodes

  • How Do I Evaluate an LLM In Healthcare?

    In this week's Health Data Ethics podcast episode, I talk about healthcare-specific methods of evaluating LLM output - a recent paper on HumanELY, a web tool for evaluating LLM output across five separate axes, is a great lens for thinking about your ai tools. I also discuss a recent evaluation of GPT-4 Vision in which our AI friend ends up with the right answer to a medical case but can't quite tell us why.

    10 min
  • How Does Scientific Self-Governing Work?

    In this episode I review The Code Breaker, a biography of Jennifer Doudna by Walter Isaacson. I talk about previous moral panics about new technology (recombinant DNA!) and compare with artificial intelligence today. 

    10 min
  • What Does A Biased AI Look Like, Anyway?

    In this episode of the Health Data Ethics podcast I dive into a recent paper in Lancet Digital Health about GPT-4 perpetuating racial and gender biases when asked to diagnose patients. After a victory lap, we settle in to talk about what this means for the use of LLMs as a diagnostic tool and what healthcare teams might want to consider if they implement this technology.

    10 min
  • How Do I Evaluate An AI Tool? - Part 1

    In this episode I begin laying out a framework for how to evaluate AI tools in the healthcare environment, starting with short vs long term impact, the value of a Super Bowl commercial, and figuring out tasks that AIs are good at. 

    6 min
  • Human vs. Digital Scribes, What's the Difference?

    I'm back with an episode in which I discuss patient attitudes towards human scribes, revisit some 2018 predictions about digital scribes, and make a new recommendation when your healthcare IT group pilots a new digital documentation tool: Publish about it!

    15 min

About Health Data Ethics

From the publisher's feed

Health tech conversations, from a healthcare IT professional. We're going to talk about medical innovation, technology, and the ethical and operational considerations for health systems. In other…