Guest: Professor Anthony G Gallagher
Topic: The Crisis in Surgical Training & Proficiency-Based Progression (PBP)

Episode Summary

In this inaugural episode, Patrick Kiely sits down with Professor Tony Gallagher — founder of Proficiency-Based Progression and one of the world's leading researchers in surgical skills assessment and simulation-based training — to examine a deeply uncomfortable truth: that professional credentialing in medicine tells us almost nothing about actual clinical competence. Tony shares 30 years of evidence challenging the assumptions underpinning surgical and procedural training worldwide, and makes the case for Proficiency-Based Progression (PBP) as the superior — and inevitable — alternative.

Key Topics Covered

1. The Competence Problem in Surgery — 0:00

• Why credentials don't equal competence
• The Halsted training paradigm — developed in the late 19th/early 20th century — and why it's still in use
• How to actually find out if your surgeon is good (hint: ask the theater sister)

2. Why Current Training Metrics Are Failing — 5:08

• Procedure volume and hours logged as proxies for competence — and why they're wrong
• The misuse of Likert-type scales in surgical assessment
• Reduced work hours legislation (Europe/US) and its impact on trainee experience
• The Libby Zion case (New York) and how it changed US residency hours

3. The Yale Study That Changed Everything — 9:53

• The landmark 2002 Yale study showing simulator-trained residents made 60% fewer errors
• Why it became a citation classic — and why change was still slow

• Publication:  Gallagher & Seymour (2002). Virtual reality training for laparoscopic surgery. Annals of Surgery, October 2002. (Presented at American Surgical Association, April 2002) https://journals.lww.com/annalsofsurgery/abstract/2002/10000/virtual_reality_training_improves_operating_room.8.aspx

4. The American College of Surgeons Response — 12:29

• Gerry Healy's pivotal leadership shift at the Boston meeting
• The establishment of Accredited Educational Institutes (2006)
• Why 100+ accredited simulation centers still aren't producing the training outcomes expected

5. The Experience ≠ Competence Myth — 16:47

• Why procedure volume is a noisy surrogate for surgical skill
• How some practicing consultants perform worse than residents in training
• Objective intraoperative performance assessment as the gold standard

6. Proficiency-Based Progression: How It Works — 20:30

• The mechanics of PBP: phases, steps, errors, critical errors, and the benchmark
• Establishing benchmarks from experienced — not world-class — practitioners
• Construct validity, inter-rater reliability, and why Likert scales fail
• The role of deliberate practice (Ericsson) and why explicit, formative feedback accelerates learning

• Publication: Mazzone, Elio; Puliatti, Stefano MD; Amato, Marco; Bunting, Brendan; Rocco, Bernardo; Montorsi, Francesco; Mottrie, Alexandre; Gallagher, Anthony G. PhD, DSc||. A Systematic Review and Meta-analysis on the Impact of Proficiency-based Progression Simulation Training on Performance Outcomes. Annals of Surgery 274(2):p 281-289, August 2021. | DOI: 10.1097/SLA.0000000000004650

7. Why PBP Hasn't Been Adopted Universally — 35:27

• "It's a failure of leadership"
• Organisations that have adopted PBP: AANA, ERUS, ORSI Academy
• Incentive structures in healthcare and medical device manufacturing that slow adoption
• The Center for Medicare Services complication-rate accountability model as a potential lever

8. The Economics of PBP — 37:49

Publication: Puliatti, S., Rodriguez Peñaranda, N., Amato, M., De Groote, R., Farinha, R., Bunting, B., van Cleynenbreugel, B., Mottrie, A. and Gallagher, A.G. (2026), Randomised trial on the economic impact of proficiency-based progression vs conventional robotic surgical training. BJU Int, 137: 493-501. https://doi.org/10.1111/bju.70130 https://bjui-journals.onlinelibrary.wiley.com/doi/full/10.1111/bju.70130 — Cost-effectiveness analysis of PBP vs. conventional training. At 500 trainees/year: PBP ~€1.7M vs. conventional ~€3.5M; cost equivalence at just 25 trainees; 100% of PBP trainees reached proficiency vs. 58% conventional

9. Surgeon Skill Predicts Patient Outcomes — 40:24

• PBP applied to communication skills: deteriorating patient handover study, Cork University Hospital
• PBP applied to epidural training: 50%+ reduction in epidural failure rates for non-PBP trained group

10. PBP Beyond Medicine: The Utilities Sector — 45:42

• Reach Active case study: PBP training for utility workers to safely identify and excavate buried cables
• Over €1 million saved in avoided utility strikes in year one
• Same methodology, same results — across a non-university workforce

11. How to Implement PBP in Your Organisation — 48:25

• Start by identifying individuals who are objectively good at the task
• Work out the metrics: phases, steps, errors, critical errors
• Validate — consensus, not just agreement
• Build or select simulation tools around the validated metrics
• Train faculty on the metrics first
• Require trainees to pass the online didactic benchmark before entering the skills lab
• Train to benchmark — not to time, not to hours

12. AI, Robotics, and the Future of Training — 1:01:31

• Why AI currently measures process, not performance
• What AI will need to assess: granular, step-level surgical actions
• The endovascular sphere as the likely first domain for AI integration
• Why simulation and AI must be seen as tools, not solutions
• The inevitability of PBP adoption — the question is only when

Connect & Follow

• Show Me The Evidence Podcast
• Tony Gallagher / KU Leuven:  https://www.linkedin.com/in/anthony-g-gallagher/ 
• Google Scholar: https://scholar.google.com/citations?hl=en&user=rNTScRMAAAAJ&view_op=list_works&sortby=pubdate

Timestamps

TopicTimeThe competence problem: credentials vs. skill | 0:00
Why current training metrics are wrong | 5:08
The 2002 Yale simulator study | 9:53
ACS response and simulation center rollout | 12:29
Experience ≠ competence | 16:47
Proficiency-based progression — mechanics | 20:30
Why PBP hasn't been widely adopted | 35:27
The economics of PBP | 37:49
Surgeon skill predicts patient outcomes (NEJM) | 40:24
PBP in utilities / Reach Active case study | 45:42
How to implement PBP in your organisation | 48:25
AI, robotics, and the future of training | 1:01:31