(Note: This episode was recorded on June 22nd 2026) Jason Bryant of ArisGlobal interviews pharmacovigilance consultant Denny Lorenz of Lorenz Bratti GmbH about the CIOMS XIV expert working group guidance on safely operating AI in pharmacovigilance.
Lorenz explains the group began before ChatGPT and had to rework the guidance after November 2022, shifting from proprietary-model practices to enduring, principle-based guidance developed with regulators, academia, and industry. The principles are linked and anchored in a risk-based approach; "human oversight" is often misunderstood as sufficient on its own, but must be complemented by privacy, transparency, documentation, and governance. They discuss why AI requires ongoing monitoring and regression testing, including monitoring human–machine interaction and overtrust risk, and why many pilots stall due to unclear guardrails and metrics. An open question is how regulators will respond to reduced 100% human review once performance data is robust.
00:00 Meet the Hosts
00:55 CIOMS XIV Sets the Stage
01:49 Before and After ChatGPT
03:11 Stakeholders at the Table
03:58 Principles Over Technology
04:47 Risk Based Foundation
05:22 Human Oversight Explained
08:29 From Hype to Governance
09:36 Guardrails and Metrics
10:48 Enterprise Tools and Ad Hoc Use
11:32 Making Guidance Implementable
12:37 Why Monitoring Matters
13:19 Regression Testing Prompts
14:06 When AI Gets Too Good
15:07 Inspecting AI Reasoning
16:39 Pilot to Production Checklist
18:40 Dynamic Risk Governance
19:15 Oversight Without 100% Review
21:08 SMEs From Day One
23:10 Working Group Next Steps
24:07 Guidance Enables Trust