That Implementation Science Podcast

Welcome to Season 2! On today's show, we interview David Chambers, the Deputy Director for Implementation Science in the National Cancer Institute. We’ll talk about the history of implementation science, the false notion of science in a vacuum, the role of creativity in science, what makes a good meeting, how teams are like jam bands, and you’ll get to test your knowledge of Frank Zappa against David’s.

Mentioned during the show:

Proctor, E. K., Powell, B. J., Baumann, A. A., Hamilton, A. M., & Santens, R. L. (2012). Writing implementation research grant proposals: ten key ingredients. Implementation Science, 7, 1-13.

Curran, G.M. Implementation science made too simple: a teaching tool. Implementation Science Communications 1, 27 (2020). https://doi.org/10.1186/s43058-020-00001-z

On this episode we talk with everyone's favorite mentor, Bryan Weiner, about the history of implementation science, implementation science measurement, the Jingle Jangle Fallacy, and we quiz him on how to be a good mentor. Resources discussed during this episode include: 

Weiner, B. J., Lewis, C. C., Stanick, C., Powell, B. J., Dorsey, C. N., Clary, A. S., Boynton, M. H., & Halko, H. (2017). Psychometric assessment of three newly developed implementation outcome measures. Implementation science : IS, 12(1), 108. https://doi.org/10.1186/s13012-017-0635-3

On this episode we interview… co-host Kevin King! What?!? Again with the bro talk? Apologies to everyone in our audience but look on the bright side, you can use this time again to catch up on old Webster episodes. If you do listen, we’ll talk about the etiology of substance use and substance use disorders, examining training and education of research methods through an implementation science lens, and quiz Kevin on his knowledge of Star Wars.

Dora, J., Piccirillo, M., Foster, K. T., Arbeau, K., Armeli, S., Auriacombe, M., ... & King, K. M. (2023). The daily association between affect and alcohol use: A meta-analysis of individual participant data. Psychological Bulletin, 149(1-2), 1.

Dora, J., Schultz, M. E., Shoda, Y., Lee, C. M., & King, K. M. (2022). No evidence for trait-and state-level urgency moderating the daily association between negative affect and subsequent alcohol use in two college samples. Brain and Neuroscience Advances, 6, 23982128221079556.

Feil, M., Halvorson, M., Lengua, L., & King, K. M. (2020). A state model of negative urgency: Do momentary reports of emotional impulsivity reflect global self-report?. Journal of Research in Personality, 86, 103942.

Halvorson, M. A., Pedersen, S. L., Feil, M. C., Lengua, L. J., Molina, B. S., & King, K. M. (2021). Impulsive states and impulsive traits: A study of the multilevel structure and validity of a multifaceted measure of impulsive states. Assessment, 28(3), 796-812.

King, K. M., Feil, M. C., Halvorson, M. A., Kosterman, R., Bailey, J. A., & Hawkins, J. D. (2020). A trait-like propensity to experience internalizing symptoms is associated with problem alcohol involvement across adulthood, but not adolescence. Psychology of Addictive Behaviors, 34(7), 756.

King, K. M., Pullmann, M. D., Lyon, A. R., Dorsey, S., & Lewis, C. C. (2019). Using implementation science to close the gap between the optimal and typical practice of quantitative methods in clinical science. Journal of abnormal psychology, 128(6), 547–562. https://doi.org/10.1037/abn0000417

Kummerfeld, E., & Jones, G. L. (2023). One data set, many analysts: Implications for practicing scientists. Frontiers in psychology, 14, 1094150. https://doi.org/10.3389/fpsyg.2023.1094150

On this show co-host Kevin King will interview… Mike! Apologies in advance to anyone who is tired of hearing us talk about our work—honestly your time might be better spent watching old reruns of Webster. We talk about equity in education, the unintended consequences of implementation strategies, the ethics and obligations of conducting community based research, and Kevin quizzes Mike on his knowledge of rock climbing.

Discussed during today's show:

Ripple effects website: https://depts.washington.edu/ripple-effects/ 

Pullmann, M. D., Dorsey, S., Duong, M. T., Lyon, A. R., Muse, I., Corbin, C. M., Davis, C. J., Thorp, K., Sweeney, M., Lewis, C. C., & Powell, B. J. (2022). Expect the Unexpected: A Qualitative Study of the Ripple Effects of Children's Mental Health Services Implementation Efforts. Implementation research and practice, 3, 26334895221120797. https://doi.org/10.1177/26334895221120797

My favorite paper that has zero attention: Pullmann M. D. (2011). Effects of out-of-home mental health treatment on probability of criminal charge during the transition to adulthood. The American journal of orthopsychiatry, 81(3), 410–419. https://doi.org/10.1111/j.1939-0025.2011.01109.x 

My least favorite paper with lots of attention: Pullmann, M. D., VanHooser, S., Hoffman, C., & Heflinger, C. A. (2010). Barriers to and supports of family participation in a rural system of care for children with serious emotional problems. Community mental health journal, 46(3), 211–220. https://doi.org/10.1007/s10597-009-9208-5

Digital therapeutics and AI may be the future, but hearing two white dudes drone on about it is very much the now. Listen to Kevin and Mike take their best stab. Papers referenced include:

Damschroder, L.J., Reardon, C.M., Widerquist, M.A.O. et al. The updated Consolidated Framework for Implementation Research based on user feedback. Implementation Sci 17, 75 (2022). https://doi.org/10.1186/s13012-022-01245-0

Lin, Z., Althoff, T., & Leskovec, J. (2018). I'll Be Back: On the Multiple Lives of Users of a Mobile Activity Tracking Application. Proceedings of the 2018 World Wide Web Conference.

Mohr D, Lyon A, Lattie E, Reddy M, Schueller S. Accelerating Digital Mental Health Research From Early Design and Creation to Successful Implementation and Sustainment. Journal of Medical Internet Research 2017;19(5):e153 URL: https://www.jmir.org/2017/5/e153 DOI: 10.2196/jmir.7725

Lisa Saldana joins the show to talk about the importance of measuring and planning implementation stages and how they can help improve whether the implementation of your program will be sustained; the relative importance of engagement, readiness planning, and how good pre-implementation planning can make programs robust to challenges; the overlap between getting an implementation ready to do and behavior change at the person level and how it parallels behavior change at the organizational level; the importance of research networks, learning across multiple fields, and maintaining engagement with both your end users and your fellow scientists; and, we quiz Lisa on her knowledge of Eugene, Oregon. Lisa’s work is some of the most exciting, important, and interesting research in implementation science today.

Alley, Z. M., Chapman, J. E., Schaper, H., & Saldana, L. (2023). The relative value of Pre-Implementation stages for successful implementation of evidence-informed programs. Implementation Science, 18(1), 1-13.

Saldana, L., Chamberlain, P., Wang, W., & Hendricks Brown, C. (2012). Predicting program start-up using the stages of implementation measure. Administration and Policy in Mental Health and Mental Health Services Research, 39, 419-425.

Chamberlain, P., Brown, C. H., & Saldana, L. (2011). Observational measure of implementation progress in community based settings: the stages of implementation completion (SIC). Implementation Science, 6(1), 1-8.

Saldana, L., Chamberlain, P., Bradford, W. D., Campbell, M., & Landsverk, J. (2014). The cost of implementing new strategies (COINS): a method for mapping implementation resources using the stages of implementation completion. Children and youth services review, 39, 177-182.

Beidas, R. S., Saldana, L., & Shelton, R. C. (2023). Testing psychosocial interventions in the contexts they are meant to be delivered. Journal of Consulting and Clinical Psychology.

NCI Implementation Primer: https://cancercontrol.cancer.gov/sites/default/files/2020-07/NCI-ISaaG-Workbook.pdf

Practical IS Textbook from Brian Weiner: https://www.springerpub.com/practical-implementation-science-9780826186928.html

Wong, D.R., Schaper, H. & Saldana, L. Rates of sustainment in the Universal Stages of Implementation Completion. Implement Sci Commun 3, 2 (2022). https://doi.org/10.1186/s43058-021-00250-6

Weisz, J. R., Jensen, A. L., & McLeod, B. D. (2005). Development and Dissemination of Child and Adolescent Psychotherapies: Milestones, Methods, and a New Deployment-Focused Model.

This episode is a companion episode to our interview with Danny Almirall, and brings a special surprise guest.

Today we talk with Danny Almirall from the University of Michigan's d3C center. We talk about how learning about prime numbers set Danny up for a lifetime of teaching people about math, statistics, and methods, the difference between efficacy, effectiveness, and implementation studies, what is a SMART trial, and how do SMART trials inform adaptive interventions, what are MAISYs, and we learn a little bit about Salsa the dance and just a tiny bit about Salsa the food.

And

We mention the following papers:

Kevin’s paper on implementation science and quantitative methods

King, K. M., Pullmann, M. D., Lyon, A. R., Dorsey, S., & Lewis, C. C. (2019). Using implementation science to close the gap between the optimal and typical practice of quantitative methods in clinical science. Journal of abnormal psychology, 128(6), 547. (http://depts.washington.edu/risemh/wordpress/wp-content/uploads/2019/08/King-et-al-2019-JAbnormal-1.pdf)

SMART designs:

Almirall, D., Nahum-Shani, I., Sherwood, N. E., & Murphy, S. A. (2014). Introduction to SMART designs for the development of adaptive interventions: with application to weight loss research. Translational behavioral medicine, 4(3), 260–274. https://doi.org/10.1007/s13142-014-0265-0 

Beidas premortem paper:

Beidas, R. S., Dorsey, S., Lewis, C. C., Lyon, A. R., Powell, B. J., Purtle, J., ... & Lane-Fall, M. B. (2022). Promises and pitfalls in implementation science from the perspective of US-based researchers: learning from a pre-mortem. Implementation Science, 17(1), 55. (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9375077/)

Danny recommends we check out:

Brian Weiner (https://globalhealth.washington.edu/faculty/bryan-weiner)

Susan Murphy, PhD. (http://people.seas.harvard.edu/~samurphy/ )

Danny’s Website: https://d3c.isr.umich.edu/, and https://twitter.com/d3_center

The amazing and generous Shannon Dorsey swings by the podcast to talk about her work on pragmatic and applied implementation science, including implementing in low resource and international settings, how to build trust and working community partnerships, and putting jargon into plain language. Along the way we quiz her about bad national park yelp reviews and I give a horribly inaccurate summary of a paper I last read 20 years ago. Referenced during today's show:

Dorsey, S., Johnson, C., Soi, C., Meza, R. D., Whetten, K., & Mbwayo, A. (2023). Implementation science in plain language: The use of nonjargon terms to facilitate collaboration. Implementation Research and Practice, 4. https://doi.org/10.1177/26334895231177474

Beidas, R.S., Dorsey, S., Lewis, C.C. et al. Promises and pitfalls in implementation science from the perspective of US-based researchers: learning from a pre-mortem. Implementation Sci 17, 55 (2022). https://doi.org/10.1186/s13012-022-01226-3

Costello EJ, Compton SN, Keeler G, Angold A. Relationships Between Poverty and Psychopathology: A Natural Experiment. JAMA. 2003;290(15):2023–2029. doi:10.1001/jama.290.15.20

Westerlund, A., Sundberg, L., & Nilsen, P. (2019). Implementation of Implementation Science Knowledge: The Research-Practice Gap Paradox. Worldviews on evidence-based nursing, 16(5), 332–334. https://doi.org/10.1111/wvn.12403

Pedja Klasnja swings by the show to discuss his viewpoints as a methodologist on the outskirts of Implementation Science, from the standpoint of Human-Computer Interaction and Health Informatics. At some point in the show Kevin falls in love with Pedja, but we're not sure if Pedja noticed. 

Referenced in this episode: 

Kilbourne, A.M., Geng, E., Eshun-Wilson, I. et al. How does facilitation in healthcare work? Using mechanism mapping to illuminate the black box of a meta-implementation strategy. Implement Sci Commun 4, 53 (2023). https://doi.org/10.1186/s43058-023-00435-1