Jennifer Deal – SVP of Product Development, HealioCasey Utley – Senior UX Designer, HealioMatthew Skepner – VP of Technology, HealioWhat we cover in this episode:
Why physicians need AI at the point of care—and how they actually use it (hint: it's preparation, not bedside)The surprising discovery that physicians wanted help with patient communication and empathy, not just clinical answersBuilding a working prototype in a weekend with Cursor after starting with Figma mockupsHow Healio's RAG system combines lexical search, vector search, and semantic search across multiple trusted sourcesWhy "just use PubMed" isn't simple—five different ways to access the same data, each with trade-offsDesigning citations that physicians trust: subscripts, hover states, and progressive disclosureServing contextual ads while the LLM processes queries—a practical monetization approachHIPAA compliance and input guardrails for masking personal health informationEight LLM judges for evals: safety, medical accuracy, faithfulness, relevancy, completeness, reasoning, clarity, and overall qualityWhy physician feedback trumps LLM-as-judge feedback in high-stakes medical contextsThe role of the Healio Innovation Partners in ongoing discovery and validationHealio — Medical news, education, and clinical guidance for healthcare professionalsPubMed — Database of biomedical literatureCursor — AI-powered code editor used to build the prototype00:00 Introduction to Healio Team
01:00 Overview of Healio's Services
01:57 Introducing Healio AI
03:39 Addressing Physician Needs with AI
05:45 Building Trust in AI Solutions
13:56 Prototyping and Testing Healio AI
18:02 Refining the AI Product
21:48 Technical Architecture and Advertising Integration
25:16 Balancing Speed and Accuracy in AI Responses
26:30 Ensuring Credible and Trustworthy Content
27:41 Challenges in Data Integration and Web Crawling
29:00 Optimizing Search Strategies for Different Data Types
31:09 User Interface and Trust Building
34:31 Human Feedback and Continuous Improvement
35:41 Guardrails and Evaluations for Reliable AI
39:11 Experimenting with LLM as Judges
45:13 Future Directions and User-Centric Design