The AI Skills Lab Podcast, with Future State University

How do we move students from knowing about a discipline to performing as practitioners in it? In HR 3550 (Organization Development and Change Management), students complete a semester-long, AI-powered consulting simulation built on the Future State University platform. Across eight connected 3D simulations and a capstone reflection, students navigate an authentic 8-stage OD process, make consequential decisions under pressure, and build a longitudinal consulting portfolio deliverable and demonstrate verified consulting competencies. This session shares the course design, the integration of AI simulations with course content, student performance data and engagement outcomes, and practical strategies faculty can adapt to embed applied performance experiences in their own courses.

This conversation explores how traditional education and corporate training foster a counterproductive reliance on certainty-seeking, leaving capable professionals ill-equipped for real-world scenarios defined by incomplete information and ambiguity. It asserts that adaptive judgment is not a fixed personality trait but a developable professional capability that can be cultivated through deliberate practice, psychological safety, and immersive simulations. By replacing structured, right-answer exercises with messy, ill-structured problems, organizations can help individuals embrace productive struggle and navigate complex challenges. Furthermore, the literature highlights that generative AI heightens the need for human discernment, as certainty-seeking workers risk blindly trusting flawed or overly confident technological outputs. Ultimately, they advocate for systemic shifts in education and leadership development that prioritize resilience, flexibility, and agility over premature closure.

This presentation by Jonathan H. Westover explores the implementation of AI-powered simulations to bridge the gap between academic knowledge and real-world performance in fields like sociology and leadership. Dr. Westover details a redesign of coursework using sequential simulations that create immersive consulting engagements, fostering psychological fidelity and real-time consequence loops for students. Evidence from two distinct student cohorts demonstrates how these interactive tools help learners self-diagnose overused strengths, improve active listening, and build comfort with ambiguity. Furthermore, the framework tracks six durable skills over time, utilizing an instructor analytics dashboard and an AI mentor named Otto to provide continuous behavioral assessment. Ultimately, the workshop highlights how shifting from static theoretical exams to dynamic, scenario-based practice transforms student learning into adaptable professional judgment.

This conversation explores a research proposal that outlines a multi-course investigation led by Jonathan H. Westover and colleagues at Utah Valley University to test AI-enabled immersive simulations across diverse management disciplines. Building on a successful summer 2026 pilot in a single leadership course, the study expands across thirteen course sections in fall 2026 and spring 2027 to examine the knowing-doing gap in management education. The authors propose a theoretical process model wherein consequential simulation tasks create productive struggle, revealing gaps between students' self-perceptions and actual performance through detailed career profile metrics. Furthermore, the research investigates how diagnostic feedback and structured reflection facilitate mental-model revision, provided that students maintain trust in the algorithmic assessment. Ultimately, this expanded initiative aims to evaluate how task characteristics—such as ambiguity, rule boundedness, and relational complexity—influence whether students develop adaptive judgment and successfully transfer their learning to novel professional scenarios.

Generation Z employees are entering the workforce with learning expectations that fundamentally clash with traditional corporate training models. Shaped by digital media, gaming, and artificial intelligence, younger workers demand continuous learning ecosystems that offer immediate feedback, practical application, and clear career progression. Rather than relying on outdated episodic workshops and completion certificates, modern organizations must adopt evidence-based learning design that aligns with established learning science principles. By updating their infrastructure to include AI-driven coaching and transparent skills frameworks, companies can better engage younger staff while simultaneously improving skill development across all workforce generations. Meeting these modern demands is no longer just a generational accommodation, but a necessary strategy for maintaining competitive capability in a rapidly evolving economic landscape.

This conversation explores Dr. Westover's research that examines the pervasive knowing–doing gap, highlighting why capable graduates frequently struggle to apply theoretical knowledge in high-stakes professional environments. It attributes this translation deficit to traditional educational models that overemphasize static recall and decontextualized testing instead of cultivating active, adaptive judgment. To bridge this divide, Dr. Westover advocates for evidence-based learning strategies such as consequential simulations, productive failure, and structured feedback. Furthermore, the research explores how modern structural pressures, including shrinking entry-level apprenticeships and the rise of artificial intelligence, make these practical teaching methods more urgent than ever. Ultimately, the research argue that transforming education requires shifting away from passive content delivery toward realistic behavioral practice that builds true workplace readiness.

Productive failure demonstrates that initial struggles and errors before receiving formal instruction actually build deeper conceptual understanding and long-term transfer compared to traditional, smooth teaching methods. Educational systems and workplaces often mistakenly optimize for immediate performance fluency, yet desirable difficulties and error management training prove that early setbacks foster essential adaptive judgment. Psychological, cultural, and structural barriers frequently discourage organizations from embracing productive struggle, leading to an illusion of readiness among professionals and students alike. To counter this, educational and corporate environments must deliberately sequence struggle before instruction, utilize low-stakes simulations, and conduct structured debriefs with credible feedback. Ultimately, individuals and leaders are encouraged to reframe effort as a positive signal, transforming inevitable setbacks into lasting professional capabilities.

This conversation explores Dr. Jonathan H. Westover's research that examines the significant self-perception gap between how individuals evaluate their own abilities and how they actually perform, particularly in crucial interpersonal and leadership domains. It highlights that traditional learning environments and conventional feedback mechanisms frequently fail to calibrate self-awareness, leaving many capable people and graduates overconfident and poorly prepared for real-world pressures. To resolve this issue, the research advocates for behavioral mirrors—such as immersive simulations paired with structured reflection and repeated practice—which present learners with objective evidence of their actions. Ultimately, the literature argues that organizations and educational institutions must transition from measuring surface-level confidence to cultivating true calibration through evidence-based career profiles and developmental feedback systems.

This academic study investigates the effectiveness of AI-driven simulations in teaching adaptive leadership to undergraduate students. By analyzing student reflections, the author explores how interactive workplace scenarios and personalized feedback help learners bridge the gap between theoretical knowledge and practical application. The research highlights a "dip-then-climb" learning trajectory, where initial struggles in the simulation lead to deeper metacognitive growth and a greater tolerance for managerial ambiguity. Key findings suggest that these digital tools act as "mirrors with teeth," forcing students to confront discrepancies between their self-perceptions and their actual performance. Ultimately, the source argues that combining consequence-driven simulations with structured reflection significantly improves relational skills and emotional intelligence in emerging leaders.

What if the tests your organization relies on to identify great leaders are actually pointing you in the wrong direction? In this episode, your cohosts dig into a provocative article by Dr. Jonathan H. Westover that starts with a striking story: a Fortune 100 company ran every leadership assessment in the book, promoted their top scorers — and then checked the data three years later. The results were humbling. High scorers had stalled. Low scorers had become the organization's best leaders.

So where did the process go wrong? The instruments weren't broken. The problem, as one executive put it, was simpler and more uncomfortable than that: "We were measuring what was easy to measure, not what actually mattered."

Your cohosts unpack why conventional testing is genuinely well-suited to knowledge and fundamentally mismatched to judgment, communication, and leadership — and what the research actually says about methods that work better, from behavioral observation and work samples to assessment centers and immersive simulation. They'll also get into the thorny human side of all this: the self-perception blind spot that makes us poor judges of our own interpersonal effectiveness, the equity implications of relying too heavily on abstract cognitive testing, and why separating developmental feedback from high-stakes evaluation might be the most underrated move an organization can make.

Whether you're in HR, leadership development, or just someone who's ever suspected that a test score didn't quite capture what you're actually capable of, this one's for you.