The Testing Psychologist Podcast

561. Digital vs. Analog Administration: Research & Practice


Listen Later

Would you rather read the transcript? Click here.

As we continue our exploration of modern assessment, I wanted to dive deep into the long-standing debate between digital and paper-based administration. While many of us have made the switch to platforms like Q-interactive, concerns about mode effects and statistical differences in scores remain a common point of anxiety. In this discussion, I review the robust research confirming cross-mode equivalence for most cognitive subtests, but I also highlight critical nuances like technology anxiety in older adults and the tactile friction gap that can influence fine motor performance. We also look at the significant advantage of digital tools in eliminating the 5% human error rate common in manual scoring. To wrap up, I outline a 2026 mode integrity protocol to help you maintain data purity, including screening for digital literacy and proper documentation of your administration methods.

Main Topics

  • 00:35: The evolution of digital platforms and research regarding mode effects
  • 01:15: Meta-analysis findings on cross-mode equivalence for cognitive subtests
  • 01:50: User experience bias and the impact of technology anxiety on older adults
  • 03:02: The tactile friction gap and how stylus-on-glass influences motor speed
  • 04:15: Human error rates in manual scoring and the benefits of digital clerical accuracy
  • 05:40: Granularity in timing and the value of millisecond-accurate digital precision
  • 06:45: The 2026 mode integrity protocol for clinical practice
  • 08:35: Best practices for documenting digital administration and AI disclosures in reports
  • Cool Things Mentioned

    • The Testing Psychologist mastermind groups and business consulting
    • Reverb: the premier AI-powered report-writing platform for testing psychologists
    • Featured Resources

      TherapyNotes is the leading EHR system for mental health practitioners. I’ve used TherapyNotes for over 10 years, and it just keeps getting better. Use this link and the promo code “testing” to get two free months and try it for yourself! www.therapynotes.com/testing

      The Testing Psychologist podcast is approved for CEU’s!

      I’ve partnered with At Health to offer CE credits for podcast episodes! Visit this link to access current and past episodes available for CE credit. You can use code “TTP10” for a discount on ALL the course credits you purchase from At Health!th!

      About Dr. Jeremy Sharp

      I’m a licensed psychologist and Clinical Director at the Colorado Center for Assessment & Counseling, a private practice that I founded in 2009 and have grown to over 20 clinicians. I earned my undergraduate degree in Experimental Psychology from the University of South Carolina before getting my Master’s and PhD in Counseling Psychology from Colorado State University. These days, I specialize in psychological and neuropsychological evaluation with kids and adolescents.

      As the host of the Testing Psychologist Podcast, I provide private practice consulting for psychologists and other mental health professionals who want to start or grow psychological testing services in their practices. I live in Fort Collins, Colorado with my wife (also a therapist) and two young kids.

      Ready to grow your testing services? Click below to get on the waitlist!

      Join the Waitlist

      ...more
      View all episodesView all episodes
      Download on the App Store

      The Testing Psychologist PodcastBy Dr. Jeremy Sharp: Licensed Psychologist & Private Practice Consultant

      • 4.8
      • 4.8
      • 4.8
      • 4.8
      • 4.8

      4.8

      200 ratings


      More shows like The Testing Psychologist Podcast

      View all
      This American Life by This American Life

      This American Life

      91,260 Listeners

      Hidden Brain by Hidden Brain, Shankar Vedantam

      Hidden Brain

      43,643 Listeners

      The Moth by The Moth

      The Moth

      27,000 Listeners

      Speaking of Psychology by American Psychological Association

      Speaking of Psychology

      57 Listeners

      ADHD Experts Podcast by ADDitude

      ADHD Experts Podcast

      1,329 Listeners

      Being Well with Forrest Hanson and Dr. Rick Hanson by Rick Hanson, Ph.D., Forrest Hanson

      Being Well with Forrest Hanson and Dr. Rick Hanson

      2,526 Listeners

      The Daily by The New York Times

      The Daily

      113,294 Listeners

      Where Should We Begin? with Esther Perel by Esther Perel Global Media

      Where Should We Begin? with Esther Perel

      14,966 Listeners

      The Slowdown: Poetry & Reflection Daily by American Public Media

      The Slowdown: Poetry & Reflection Daily

      1,214 Listeners

      The Happiness Lab with Dr. Laurie Santos by Pushkin Industries

      The Happiness Lab with Dr. Laurie Santos

      14,318 Listeners

      Ask Lisa: The Psychology of Raising Tweens & Teens by Dr. Lisa Damour/Reena Ninan

      Ask Lisa: The Psychology of Raising Tweens & Teens

      87 Listeners

      Reimagining Love with Dr. Alexandra Solomon by Dr. Alexandra Solomon

      Reimagining Love with Dr. Alexandra Solomon

      295 Listeners

      Wiser Than Me with Julia Louis-Dreyfus by Lemonada Media

      Wiser Than Me with Julia Louis-Dreyfus

      10,852 Listeners

      What Now? with Trevor Noah by Trevor Noah

      What Now? with Trevor Noah

      4,306 Listeners