Impact Champions

If you want to measure the impact of your learning programs, start with reaction surveys.

They're the most valuable learning metric you can collect for any course — no matter the subject, length, or audience. Best of all, they’re quick and easy to gather.

We talk about:

1. Why reaction surveys are critical for learning evaluation
2. How they fit into measuring training impact
3. Tips to start collecting them today

Whether you’re in L&D, eLearning, instructional design, or training management, this is the simplest and most effective way to begin tracking your learning outcomes.

---

About the Hosts and Guests

Andrew Bloye is the Managing Director of ClearXP

David N. Johnson is the Chief Technology Officer of ClearXP

---

Brought to you by

ClearXP: Measure learning impact

---

Topics

(00:00) Introduction to reaction surveys and why they're so important

(01:04) When should you capture reaction surveys

(03:15) Different ways to collect learner feedback

(05:07) What are the right questions to ask?

(06:59) Should rating scales include a neutral option?

(09:13) The best timing for collecting feedback

(10:34) How to analyse feedback results and why averages can be misleading

(14:08) Tying survey results back to business impact

(16:00) Summary and outro

---

References

The easiest and most effective way to start measuring learning impact

We get in the weeds with Chris Daniel, Senior LMS Strategist at Eastern Kentucky University. Chris co-founded EKU's instructional design master's program and is field faculty for the University of Kentucky.

We talk about:

1. Cognitive Load Theory and the importance of learning efficiency
2. Using NASA's Task Load Index to measure learning efficiency
3. Starting with Catherine Sleezer's Needs Assessment prior to building training
4. Tips for engaging learners to drive learning completions
5. What AI can do now and where it could help in the future

You can reach Chris at [email protected] or [email protected]

---

Brought to you by

ClearXP: Start measuring your learning impact

---

Topics

(00:00) Introduction to Chris Daniel

(00:58) How to measure learning efficiency using Cognitive Load Theory

(03:15) Are narrative simulations more effective than text and image?

(07:57) Why learning efficiency matters

(10:45) Practical advice for measuring learning efficiency

(13:20) Can Kirkpatrick Level 1 be used to evaluate effectiveness?

(18:45) The role of Instructional Designers and challenges they face

(21:30) Sleezer's Needs Analysis explained

(25:40) How do we actually get people to do the training?

(29:05) How AI is speeding up University faculty

(32:04) Chris' vision for the future of AI agents

(37:15) Kentucky vs Australia

---

References

Learning From Media: Arguments, Analysis, and Evidence | Richard E. Clark

Cognitive Load Measurement as a Means to Advance Cognitive Load Theory | Fred Paas

A Practical Guide to Needs Assessment | Catherine M. Sleezer, Darlene F. Russ-Eft, Kavita Gupta

Map It: The hands-on guide to strategic training design | Cathy Moore

Instructional Illusions | Paul A. Kirschner

Andrew Yang's Freedom Dividend Tax

Go inside Fulton Hogan’s massive upskilling wave as Learning & Capability Manager Luke Rogers shares how his team is training 11,000+ employees across New Zealand and Australia for a multi-year ERP rollout.

You’ll see the blended learning playbook (targeted e-learning + hands-on workshops + live sandboxes), how Oracle Guided Learning powers “learning in the flow of work,” and the metrics that matter—attendance, pre/post confidence lifts, speed-to-competence, and support-desk deflection. We also unpack change management in a decentralized workforce and lessons learned (what worked, what didn’t—looking at you, misaligned gamification).

Perfect for L&D leaders, change managers, ERP project teams, and operations leaders in construction & infrastructure.

---

About the Hosts and Guests

Luke Rogers is the Learning & Capability Manager for Fulton Hogan

Andrew Bloye is the Managing Director of ClearXP

David N. Johnson is the Chief Technology Officer of ClearXP

---

In this Episode

(0:00) Introduction & Meet the Guests, and about Fulton Hogan's ERP roll-out

(4:50) The L&D approach to systems training at Fulton Hogan

(8:45) How success is measured for ERP systems training

(12:30) (Just some run-of-the-mill LMS bashing)

(13:49) Gamification for knowledge assessments: did it work?

(18:30) Retention and analytics for executives

(21:10) How frontline training is delivered at Fulton Hogan

(26:50) How the ERP pilot influenced the full roll-out

(30:18) Measuring job performance against provided learning

---

Referenced

Impact Champions podcast on Gamification (literally the episode before this one)

Oracle Guided Learning (OGL)

How do you use gamification effectively in your learning? In this episode of Impact Champs, we break down how to use gamification in corporate learning the right way.

Learn when to use simulations, points, badges, leaderboards, and streaks; how to align rewards with learning outcomes (not vanity clicks); and how to measure real impact with analytics.

Expect practical examples (Duolingo, Stack Overflow), tips to prevent “gaming the system,” and design ideas you can apply to your next learning module. Perfect for L&D leaders, instructional designers, and learning technologists looking to drive engagement and performance.

Side-note: ClearXP makes gamification really easy.

---

About the Hosts and Guests

Andrew Bloye is the Managing Director of ClearXP and has built many rich, interactive learning programs for large corporate clients.

David N. Johnson is the Chief Technology Officer of ClearXP

---

In this Episode

(0:00) Introduction & Meet the Guests

(1:30) What Is Gamification and why it's important

(4:00) Gamification needs to align with expected learner behaviours

(7:04) How do build simulations with effective reward mechanisms

(13:30) Leaderboards: when they work well and when they don't

(16:05) Can gamification in learning detract from productivity at work?

(17:10) Badges: how to use them effectively

(22:05) How social learning and recognition can improve learning effectiveness

(23:35) Duolingo's use of gamification (especially streaks and leaderboards) to keep learners hooked

(30:58) How Stack Overflow used gamification to become one of the largest Q&A sites on the web

(38:20) When rewards become a perverse incentive

(40:25) Summary of what we've learned and wrap up

---

Referenced

How to hook 500M users: breaking down Duolingo’s gamification | Mary Borysova

Reputation in Stack Overflow

Reputation Gaming in Stack Overflow | Iren Mazloomzadeh, Gias Udin, Foutse Khomh, Ashkan Sami

Impacts of gamification on intrinsic motivation | Camilla Dahlstrøm, Norwegian University of Science and Technology

What if you could finally see the real impact of learning? In this episode of Impact Champions, Andrew, David, and special guest Julian Davis (founder of xAPI.com.au) unpack how xAPI (Experience API) is transforming the way organizations measure, track, and prove learning effectiveness.

Discover what xAPI is, why it’s more powerful than SCORM, and how it’s being used across industries—from VR training to defense—to capture meaningful learning data. Expect real-world examples, expert insights, and practical advice for implementing xAPI to drive measurable learning impact.

Learn more at xapi.com.au

---

About the Hosts and Guests

Julian Davis is a National Advisory Board Member for the Institute for Learning & Performance, Asia Pacific and founder of xapi.com.au

Andrew Bloye is the Managing Director of ClearXP

David N. Johnson is the Chief Technology Officer of ClearXP

---

In this Episode

(0:00) Introduction & Meet the Guests

(0:55) What Is xAPI and Why It Matters

(5:33) Real-World Applications and Early Use Cases

(12:22) Unlocking Powerful Data & Learning Analytics

(19:50) Overcoming Challenges and Shifting Learning Mindsets

(25:10 ) The Future of Learning: xAPI, AI, and Real Impact

We provide a brief introduction into measuring learning impact and what we're trying to achieve with this podcast. We talk about:

1. Providing L&D professionals with practical advice on how to measure impact
2. Why it's important to connect training outcomes to business success
3. How learning metrics differ from Kirkpatrick evaluation levels
4. Give a brief overview of real world example of how to measure impact (increasing retention through onboarding)

About the Hosts and Guests

Andrew Bloye is the Managing Director of ClearXP

David N. Johnson is the Chief Technology Officer of ClearXP

Brought to you by

ClearXP: Measure learning impact

Topics

(00:00) Introduction to Impact Champions

(01:30) Who is this podcast for?

(03:45) Why we need to focus on learning impact

(05:30) Learning impact metrics vs Kirkpatrick

(07:03) Real example: How to Improve Retention

(09:15) How to get started measuring impact

References

The Kirkpatrick Model