The Test Community.Network

A Practical Guide to Authoring Test Items with Artificial IntelligenceTim Burnett, Founder of the Test Community Network, is publishing a brand-new guide: A Practical Guide to Authoring Test Items with Artificial Intelligence. In this live session, Tim will walk you through the guide, sharing the key findings, practical techniques, and insights gathered during a research sprint conducted with practitioners, psychometricians, and assessment professionals from across the international community.What the Guide CoversThe guide tackles one of the most pressing questions facing assessment organisations today: how do you use AI to generate high-quality multiple-choice items without compromising on validity, fairness, or security?Rather than treating AI as a magic button that produces ready-made questions, the guide sets out a structured, evidence-informed approach. It recognises that introducing AI into item authoring fundamentally changes the workflow — shifting the skill requirement from writing questions to instructing AI how to write questions well.What Tim Will Cover in the WebinarDuring the session, Tim will take you through the highlights of the guide, including:The two-stage prompt workflow — One of the guide's central recommendations is that item generation should not be treated as a single-step process. The first stage focuses on generating the question stem and correct answer, grounded in approved source material. Only once these have been reviewed and approved should distractors be generated in a second stage. This approach addresses a common pitfall: when stems, keys, and distractors are generated together, edits to one element can silently undermine the others.Different approaches to AI-assisted authoring — There is no single way to implement AI in your item development process. Tim will explore the practical trade-offs between using conversational chat assistants, configurable AI agents, and dedicated SaaS-based authoring platforms. Each comes with its own strengths and constraints, from the flexibility of building your own agent architecture to the structured workflows offered by embedded platforms.Tips and techniques from the research — Tim will share the practical lessons discovered during the sprint, including how to craft prompts that produce genuinely plausible distractors (not just random wrong answers), why uploading entire textbooks as context can do more harm than good, how to manage token costs without sacrificing quality, and why a "blind review" style SME answer check can prevent anchoring bias.Insights from the assessment community — The guide draws on contributions from practitioners across the sector. Tim will share some of the most valuable insights that emerged, from the challenges of keeping SMEs meaningfully engaged when AI drafts become increasingly polished, to the often-overlooked security risk of item pre-exposure when independent users generate similar items from similar prompts.

In this week's episode, Tim Burnett chats with Med Kharbach, PhD, an educator, researcher, and part-time faculty member at Mount Saint Vincent University.
They discuss:
- AI literacy for educators and students — what AI-literate students do differently and why freely available practitioner guides matter more than academic jargon
- Rethinking assessment design in an AI-saturated world — moving from traditional submissions towards layered, process-focused approaches that value critical thinking over polished outputs
- Building an AI-forward mindset — why pedagogy should come before tools, and why a single chatbot with strong prompting skills can be more powerful than a dozen subscriptions
Med shares his journey from teaching English as a foreign language to becoming a leading voice in AI and education, with multiple publications for integrating AI into learning.
The conversation explores the rapid evolution of AI capabilities, from the early days of garbled text in AI-generated images to today's near-undetectable outputs, and what that means for academic integrity.
Med advocates for assessment methods that make the learning process visible, such as reflective journals, chat log analysis, and oral defences, whilst acknowledging the scalability challenges teachers face with larger class sizes.
The episode closes with Med's advice to educators: embrace AI, focus on your pedagogy first, and don't chase every shiny new tool, a mainstream chatbot and solid prompting skills are more than enough to get started.
Explore Med Kharbach's research and free educator guides: https://medkharbach.com/
Connect with Med Kharbach on LinkedIn: https://www.linkedin.com/in/mkharbach/
Connect with Tim Burnett on LinkedIn: https://www.linkedin.com/in/tburnett/
If you would like to join Tim on a future episode or sponsor the Test Community Network then get in touch with Tim to schedule a call: https://calendly.com/educationtech/15min-teams-chat
Events: https://www.testcommunity.network/upcoming-events
Podcasts: https://www.testcommunity.network/podcasts
Marketplace: https://www.testcommunity.network/marketplace
Subscribe to the Test Community Network here: https://www.testcommunity.network

In this week's episode, Tim Burnett chats with Ben Smith, from Gordon Associates. They discuss the upcoming AO Forum 2026, the evolving role of AI in awarding bodies, and what's new across Gordon Associates' product suite.
They discuss:
The AO Forum 2026 – What to expect from this year's event on 22nd April in London, including a heavyweight regulator panel featuring Ofqual, Qualification Wales, SQA, and Skills England, plus standout speakers from Vetskill, Innovate, and ASRG.
AI adoption in the awarding body world – How awarding organisations are exploring AI to streamline day-to-day tasks, and how Gordon Associates are embedding AI functionality into their Monarch governance and compliance platform.
Examination security and deception devices – The growing sophistication of cheating tools, from social engineering to agentic AI platforms, and why awareness is more important than ever.
Ben shares how the AO Forum has become an essential fixture in the sector calendar — a relaxed, informal day where awarding bodies can hear directly from regulators, connect with peers facing similar challenges, and take away practical insights. He also gives an update on Gordon Associates' plans for AI integration into Monarch, plus the changes they're preparing for in the EPA world with their Talus software ahead of the upcoming framework reforms. Tim and Ben also touch on the fascinating and slightly unsettling world of examination cheating, previewing Niamh from ASRG closing talk on deception devices.
The AO Forum takes place on 22nd April at Woburn House, London. Early bird tickets are £150+VAT if booked before the end of March.
Register for the forum: https://www.awardingorganisation.com/
Connect with Ben Smith on LinkedIn: https://www.linkedin.com/in/ben-smith-15a448144/
Connect with Tim Burnett on LinkedIn: https://www.linkedin.com/in/tburnett/
If you would like to join Tim on a future episode or sponsor the Test Community Network then get in touch with Tim to schedule a call: https://calendly.com/educationtech/15min-teams-chat
Events: https://www.testcommunity.network/upcoming-events
Podcasts: https://www.testcommunity.network/podcasts
Marketplace: https://www.testcommunity.network/marketplace
Subscribe to the Test Community Network here: https://www.testcommunity.network

In this week's episode, Tim Burnett chats with Dr. Erin Leeming, Doctor of Speech and Language Pathology at the University of Central Florida. They discuss:

- Using an escape room as an alternative assessment method for a phonetics class, and how it reduced student anxiety while revealing deeper learning

- The role of immersive technology, including a hologram machine, in creating realistic clinical experiences for students

- Why rethinking traditional exams can build learner confidence and better prepare students for real-world practice

Dr. Erin Leeming shares how her own experience with ADHD inspired her to design assessments that move beyond traditional exams. She walks us through the escape room she built for her phonetics students, where teams decoded the International Phonetic Alphabet to solve puzzles and "escape." Student feedback was overwhelmingly positive, with many saying they didn't realise how much they knew until they experienced assessment this way. Erin also previews her next project — using a hologram of a real patient to give students a lifelike clinical assessment experience before they enter the field. Tim and Erin explore the broader need to evolve assessment practices, especially in an era of AI and academic integrity challenges, and discuss how technology can make assessment both more meaningful and more fun.

Connect with Dr. Erin Leeming on LinkedIn: https://www.linkedin.com/in/erin-leeming-24a004296/

Escape Room Video: https://www.youtube.com/watch?v=mxZoV5sRmho

Hologram Clip from UCF: https://www.youtube.com/watch?v=44d0E75w_PM

Connect with Tim Burnett on LinkedIn: https://www.linkedin.com/in/tburnett/

If you would like to join Tim on a future episode or sponsor the Test Community Network then get in touch with Tim to schedule a call: https://calendly.com/educationtech/15min-teams-chat

Events: https://www.testcommunity.network/upcoming-events

Podcasts: https://www.testcommunity.network/podcasts

Marketplace: https://www.testcommunity.network/marketplace

Subscribe to the Test Community Network here: https://www.testcommunity.network

Safety Training Awards didn't go looking for an AI marking solution — but a chance conversation led them to sAInaptic, and it's already transforming how their tutors deliver feedback on swimming teacher lesson plans. In this episode, STA's Director of Education Kaylë Brightwell joins sAInaptic co-founders Raj Iyer and Kavitha Ravindran to share what happened when they took the leap — from impressing regulators to getting detailed, criteria-referenced feedback back to learners in eight seconds flat.

Read more about the webinar here:https://testcommunity.network/how-sta-is-making-ai-marking-work-responsibly-and-on-their-own-terms

Visit sAInaptic: https://www.sainaptic.com/

Connect with Kaylë: https://www.linkedin.com/in/kayle-brightwell-b2a199b1/

Connect with Raj: https://www.linkedin.com/in/rajiyer26/

Connect with Kavitha: https://www.linkedin.com/in/kravindran/

In this week's episode, Tim Burnett chats with E.W. Looney, CEO and Founder of BrightLink, a technology company and advisory firm specialising in credentialing programme management.
They discuss:
- The Complexity Wall in Credentialing - How programmes hit predictable scaling challenges when manual processes break down under volume and regulatory scrutiny
- AI Teammates in Operations - BrightLink's AI agents Rosie and Scout that work alongside staff to manage applications, eligibility, bursary requests, and candidate communications
- The Future of Technology Interfaces - Model Context Protocol (MCP), the shift from forms to conversational AI, and how natural language interfaces are transforming candidate experiences
E.W. shares BrightLink's 19-year journey from custom software development to becoming a leader in credentialing technology, explaining how they help organisations manage the full lifecycle of candidate records, from applications and eligibility through to assessment results, renewals, and continuing education.
The conversation explores the "complexity wall" that credentialing programmes face when spreadsheets and email heroics can no longer handle increased volume, scope expansion, or regulatory requirements. E.W. explains how programmes often have to choose between hiring more staff or letting standards slip, neither of which is sustainable.
BrightLink's approach centres on using AI as a teammate rather than a replacement. Rosie, their AI agent, handles tasks like evaluating bursary documentation using computer vision, whilst maintaining the critical distinction between probabilistic AI decisions and deterministic system-of-record accuracy. E.W. emphasises the importance of context in building quality AI solutions and how MCP bridges the gap between AI capabilities and official systems.
Looking ahead, E.W. discusses how AI has raised both the ceiling of what's possible and the floor of what's expected, candidates now expect instant responses and real-time updates, whilst regulators demand ISO compliance and data residency.
The conversation touches on emerging natural language interfaces that could allow candidates to book test centres conversationally, and the exciting design challenges of choosing the right interface for each use case.
Connect with E.W. Looney on LinkedIn: https://www.linkedin.com/in/ewlooney/
Learn more about BrightLink: https://thebrightlink.com/
Connect with Tim Burnett on LinkedIn: https://www.linkedin.com/in/tburnett/
If you would like to join Tim on a future episode or sponsor the Test Community Network then get in touch with Tim to schedule a call: https://calendly.com/educationtech/15min-teams-chat
Events: https://www.testcommunity.network/upcoming-events
Podcasts: https://www.testcommunity.network/podcasts
Marketplace: https://www.testcommunity.network/marketplace
Subscribe to the Test Community Network here: https://www.testcommunity.network

In this week's episode, Tim Burnett chats with Rosie Applin and Dr Simon Child from Cambridge University Press & Assessment about the upcoming Assessment Horizons Conference 2026. They discuss:

• The emotional science of feedback and why understanding learners' emotional responses is critical for effective assessment design — featuring keynote speaker Anastasiya A. Lipnevich
• How "productive failure" can deepen learning and act as a counterbalance to concerns about AI reducing cognitive load — featuring keynote speaker Professor Manu Kapur
• The ongoing tension between AI innovation and maintaining proven learning methods, including surprising research on the enduring value of handwriting for comprehension and retention

The conversation covers all the practical details of this year's conference, taking place on 23–24 April in Cambridge and online, now in its third year. Rosie explains how the programme has been shaped by survey responses from around 160 professionals, with AI and assessment emerging as a dominant theme — from ethical considerations to integrating AI across the assessment lifecycle. Simon shares a preview of his own research presentation comparing parental trust in assessment data between England and Australia, revealing fascinating cultural differences in how parents engage with school reporting. The episode also touches on the value of in-person networking for assessment professionals, the complementary online offer for international attendees, and the wider work of the Assessment Horizons community. Early bird tickets close on 27 February, saving around £50 on the ticket price.

Conference details and tickets: https://www.cambridgeassessment.org.uk/events/assessment-horizons-2026/

Find out more about the keynote speakers:Professor Manu Kapur: https://www.manukapur.comAnastasiya A. Lipnevich: https://www.anastasiyalipnevich.com/

Cambridge research — Note taking more effective than AI for learning: https://www.cambridge.org/news-and-insights/note-taking-more-effective-than-ai-for-learning

Connect with Rosie Applin on LinkedIn: https://www.linkedin.com/in/rosieapplin/Connect with Dr Simon Child on LinkedIn: https://www.linkedin.com/in/dr-simon-child-44073656/

Connect with Tim Burnett on LinkedIn: https://www.linkedin.com/in/tburnett/

If you would like to join Tim on a future episode or sponsor the Test Community Network then get in touch with Tim to schedule a call: https://calendly.com/educationtech/15min-teams-chat

Events: https://www.testcommunity.network/upcoming-events

Podcasts: https://www.testcommunity.network/podcasts

Marketplace: https://www.testcommunity.network/marketplace

Subscribe to the Test Community Network here: https://www.testcommunity.network

What does the global assessment community need to be talking about right now — and who needs to be in the room? Dan Koenig, CEO of EQAO, shares his vision for the 51st IAEA Annual Conference in Toronto this September. From public trust and equity to AI and digital transformation, this is a conversation about why your voice matters.Visit: https://testcommunity.network/iaea-2026-why-we-need-your-voice-in-the-room

IAEA Conference Website: https://www.eqao.com/iaea-annual-conference/

In this week's episode, Tim Burnett chats with Tim Cammack, a veteran of the exam and education print industry with over 15 years at SCD. They discuss:

• The myths around paper and sustainability – why paper is actually more environmentally friendly than many believe
• How digital and paper coexist in the examination world, and why paper remains essential for integrity and resilience
• The hidden environmental footprint of digital devices versus the transparent recyclability of paper

Tim Cammack explains the work of Two Sides and their Love Paper campaign, which aims to bust common myths about paper's environmental impact. He highlights that European forests are actually growing, and FSC-certified paper comes from sustainable sources. The conversation explores how paper fits into a multimodal approach to examinations, offering resilience that digital systems sometimes lack – particularly when technology fails during critical exam periods. Tim shares examples of awarding bodies returning to paper after experiencing issues with digital delivery, and discusses why physical certificates remain valuable for their commemorative and security qualities. The episode wraps up with a thoughtful comparison of paper's transparent recyclability versus the hidden environmental costs of laptops, devices and rare earth minerals.

Connect with Tim Cammack on LinkedIn: https://www.linkedin.com/in/timcammack/

Connect with Tim Burnett on LinkedIn: https://www.linkedin.com/in/tburnett/

If you would like to join Tim on a future episode or sponsor the Test Community Network then get in touch with Tim to schedule a call: https://calendly.com/educationtech/15min-teams-chat

Events: https://www.testcommunity.network/upcoming-events

Podcasts: https://www.testcommunity.network/podcasts

Marketplace: https://www.testcommunity.network/marketplace

Subscribe to the Test Community Network here: https://www.testcommunity.network

In this week's episode, Tim Burnett chats with Ed Swift, Head of Philosophy and Religion at Wellington College in Berkshire, with fifteen years of teaching experience and a background as a Director of Teaching and Learning. They discuss:

• Implementing a traffic light system (red, amber, green) for AI use in the classroom to help pupils understand when and how it's appropriate to engage with AI tools
• The challenge of cognitive offloading and ensuring students develop critical thinking skills rather than relying on AI for quick answers
• Practical approaches to monitoring and safeguarding AI use in schools

Ed shares his school's philosophy towards AI adoption, where rather than banning platforms, they focus on monitoring and educating pupils on appropriate use. He explains their innovative traffic light system: red tasks prohibit AI entirely (tests, exams), amber tasks allow guided AI use with full prompt submissions alongside work, and green tasks permit broader AI engagement with transparency requirements.

The conversation explores practical classroom applications, including Ed's use of NotebookLM to create closed-source language models containing set texts for A-Level and IB students to dialogue with. He discusses the balance between leveraging AI tools like Copilot Researcher for synthesising research materials whilst ensuring pupils still engage deeply with primary sources.

Ed reflects on the recently updated DfE Generative AI: product safety standards, which now includes additional guidance around:

• Cognitive development – introducing a 'schools mode' concept to prevent AI from simply providing quick answers and encouraging deeper learning
• Emotional and social development – requiring tools to avoid anthropomorphising AI, drop conversational modes that imply agency, and include time-limits on use
• Mental health – mandating tools detect signs of learner distress, signpost to human support, and involve child mental health expertise in product design
• Manipulation – preventing tools from deceiving users, displaying unjustified confidence, using peer-pressure tactics, or steering users towards paid options

Ed connects these guidelines to the reversal of the Flynn effect – the observation that human intelligence, which had been rising throughout the twentieth century, has begun to decline since the rise of devices and AI. He emphasises that educators must teach students when to harness AI as a tool and when to think slowly and critically without it. The episode also touches on safeguarding challenges, the importance of school-managed devices for visibility, and the widening resource gap between independent and maintained schools in AI adoption.

Resources mentioned in this episode:

DfE Guidance: Generative AI: product safety standards – These standards outline the capabilities and features that generative AI products and systems should meet to be considered safe for users in educational settings. They are mainly intended for edtech developers and suppliers to schools and colleges. Schools and colleges may also find these standards helpful in assessing which AI products are safe for use in education.https://www.gov.uk/government/publications/generative-ai-product-safety-expectations

Connect with Ed Swift on LinkedIn: https://www.linkedin.com/in/edmhswift/

Connect with Tim Burnett on LinkedIn: https://www.linkedin.com/in/tburnett/

If you would like to join Tim on a future episode or sponsor the Test Community Network then get in touch with Tim to schedule a call: https://calendly.com/educationtech/15min-teams-chat

Events: https://www.testcommunity.network/upcoming-events

Podcasts: https://www.testcommunity.network/podcasts

Marketplace: https://www.testcommunity.network/marketplace

Subscribe to the Test Community Network here: https://www.testcommunity.network