Before mental health chatbots were a trend, Dr. Ali Darcy was already running randomised controlled trials on one.
In 2016, she and her collaborators at Stanford conducted what is widely regarded as the first ever formal RCT of a conversational AI for mental health.
The paper has since been cited over 2,000 times. Her creation, Woebot, became one of the most studied and recognised digital mental health tools in the world.
In this episode of Prove It, host Paul Wicks sits down with Ali for a wide-ranging, deeply honest conversation about what the science of AI mental health actually shows, and what it doesn't.
They cover the engagement crisis in digital CBT, why humour is a legitimate and underused therapeutic tool, the surprising finding that users form a meaningful bond with a fictional robot character, and the critical question the field still hasn't answered: what exactly is the active ingredient of the human therapist?
They also dig into the limits of large language models in mental health, why doubling NLP accuracy didn't improve outcomes, why "rushing in to help" is therapy's number one failure mode, and why role clarity may be the most important safety issue in AI mental health right now.
This is a conversation between two researchers who refuse to hand-wave. If you care about digital mental health done right, this one is for your library.
Topics covered:
- The 2016 Stanford RCT: design choices that still hold up nearly a decade later
- Engagement as the primary unsolved problem in mental health tech
- The therapeutic alliance paper: 37,000 users, 200x larger than the entire existing literature
- What Woebot got right by being transparently fictional rather than pretending to be human
- Why LLMs can generate profound-sounding insights that users forget within 24 hours
- The Goldilocks zone of evidence: how much is enough, and when does more actually hurt you?
- Role confusion as a safety crisis: why being a companion and a therapist is clinically dangerous
🎙️ Host: Paul Wicks | ProofStack Health
🏢 Guest: Dr. Ali Darcy, Founder, Woebot Health
🔗 Learn more: www.proofstack.health
📬 Subscribe to Proof Points, A biweekly newsletter on evidence that makes digital health work proofpoints.proofstack.health