Watching treatment implementation is one of the key determinants behind whether great treatments lead to great results. But, deep down in our hearts, we all struggle to hit that magic 33% of sessions with greater than 80% agreement we all learned about in graduate school. But, what if interobserver agreement didn’t have to be that. What if we were thinking about IOA all wrong? This week we brush up on some of the basics of IOA procedures like “How do I calculate IOA again?” before moving on to more interesting research in the field like training folks to take good IOA and questioning the standard wisdom of how much IOA is good enough. We’ll be watching you!

This episode is available for 1.0 LEARNING CEU.

Articles discussed this episode:

Hausman, N.L., Javed, N., Bednar, M.K., Guell, M., Schaller, E., Nevill, R.E., & Kahng, S. (2022). Interobserver agreement: A preliminary investigation into how much is enough? Journal of Applied Behavior Analysis, 55, 357-368. doi: 10.1002/jaba.811

Garrity, M.L., Luiselli, J.K., & McCollum, S.A. (2008). Effects of a supervisory intervention on assessment of interobserver agreement by educational service providers. Behavioral Interventions, 23, 105-112. doi: 10.1002/bin.258

Hartz, R.M., Gould, K., Harper, J.M., & Luiselli, J.K. (2020). Assessing interobserver agreement (IOA) with procedural integrity: Evaluation of training methods among classroom instructors. Child and Family Behavior Therapy, 43, 1-12. doi: 10.1080/00168890.2020.1848404

If you're interested in ordering CEs for listening to this episode, click here to go to the store page. You'll need to enter your name, BCBA #, and the two episode secret code words to complete the purchase. Email us at [email protected] for further assistance.