In this week's episode, Tim Burnett chats with John Kleeman, an expert in assessment and AI. John is a respected figure in the assessment industry and brings deep expertise in responsible AI implementation in educational testing.

They discuss:

- Responsible AI in education assessment - exploring how AI can make tests better through improved efficiency, reduced bias, and enhanced evaluation capabilities while maintaining human oversight

- The role of transparency in AI-powered assessment systems and the balance between commercial interests and ethical obligations

- The future of assessment in an AI-powered world, including the evolution towards continuous assessment and team-based evaluation

During their conversation, John emphasises that assessment serves as a gateway to life chances for young people and, despite its imperfections, makes the world a better place by enabling merit-based advancement. He discusses how AI can enhance assessment through improved efficiency in content creation, enhanced security measures, and better evaluation capabilities.

The discussion also ventures into the future of assessment, exploring how AI might transform traditional testing methods. John shares insights about the potential for "stealth assessment" where evaluation happens continuously during work or learning activities, and the possibility of AI-powered conversational assessments.

Looking ahead, John emphasises the exciting opportunities for newcomers to the assessment industry, encouraging them to connect with professional networks, master measurement principles, and focus on learner needs. He highlights how AI and future assessment methods might help reach billions of people who currently lack access to quality assessment.

Connect with John Kleeman on LinkedIn: https://www.linkedin.com/in/johnkleeman/

Connect with Tim Burnett on LinkedIn: https://www.linkedin.com/in/tburnett/

If you would like to join Tim on a future episode or sponsor the Test Community Network then get in touch with Tim to schedule a call: https://calendly.com/educationtech/15min-teams-chat

Events: https://www.testcommunity.network/upcoming-events

Podcasts: https://www.testcommunity.network/podcasts

Marketplace: https://www.testcommunity.network/marketplace

Subscribe to the Test Community Network here: https://www.testcommunity.network

In this week's episode, Tim Burnett chats with Steve Dept, founder of cApStAn, a company specialising in linguistic quality assurance and translation of assessments. With 25 years of experience in the field, Steve brings deep expertise in ensuring test item equivalence across languages, regions, and cultures.

They discuss:

Steve shares fascinating insights into the complexities of assessment translation, including how the PISA program expanded from 32 to 57 languages across more than 100 countries. He explains why seemingly perfect translations can still pose problems for test validity, using examples like how translating "How many sides does a hexagon have?" can inadvertently give away the answer in some languages.

The conversation also covers cApStAn's current work in AI quality estimation (AIQE) and workflow consultancy, helping organisations understand where and how to effectively implement translation technology while maintaining assessment integrity. Steve emphasises the continued importance of human expertise and post-launch data analysis in ensuring translated assessments perform as intended.

Connect with Steve Dept on LinkedIn: https://www.linkedin.com/in/stevedept/

Connect with Tim Burnett on LinkedIn: https://www.linkedin.com/in/tburnett/

If you would like to join Tim on a future episode or sponsor the Test Community Network then get in touch with Tim to schedule a call: https://calendly.com/educationtech/15min-teams-chat

Events: https://www.testcommunity.network/upcoming-events

Podcasts: https://www.testcommunity.network/podcasts

Marketplace: https://www.testcommunity.network/marketplace

Subscribe to the Test Community Network here: https://www.testcommunity.network

In this week's episode, Tim Burnett chats with Matt Wingfield, an independent consultant in the assessment sector and former Chair of the e-Assessment Association. With extensive experience supporting both technology providers and exam awarding bodies, Matt brings valuable insights on technology, best practice and innovation.

They discuss:

1. The fascinating history and principles of comparative judgement in assessment, from its Cambridge University origins to modern applications

2. How technology and AI could transform traditional assessment methods while maintaining human oversight

3. The powerful potential of comparative judgement for formative assessment and enhancing student learning

Matt shares compelling insights into why comparative judgement can be more reliable than traditional marking schemes for subjective assessments. He illustrates the concept brilliantly through real-world applications, including an illuminating parallel with eye tests at opticians, and shares insights from groundbreaking research such as that from Purdue University, demonstrating the significant benefits of comparative judgement in formative assessment.

Using a live demonstration of a comparative judgement tool created by Tim during the episode, they explore practical applications and discuss how emerging AI technologies could enhance this assessment approach, making it more efficient while preserving the crucial role of human judgment in the evaluation process.

Connect with Matt Wingfield on LinkedIn: https://www.linkedin.com/in/matt-wingfield-784b649/

Connect with Tim Burnett on LinkedIn: https://www.linkedin.com/in/tburnett/

If you would like to join Tim on a future episode or sponsor the Test Community Network then get in touch with Tim to schedule a call: https://calendly.com/educationtech/15min-teams-chat

Events: https://www.testcommunity.network/upcoming-events

Podcasts: https://www.testcommunity.network/podcasts

Marketplace: https://www.testcommunity.network/marketplace

Subscribe to the Test Community Network here: https://www.testcommunity.network

In this week's episode, Tim Burnett chats with Bob Gomersall, a renowned EdTech entrepreneur with 40 years of experience and founder of BTL (now Surpass Assessment), Virtual College, and ADI.
They discuss:
- Bob's new book about entrepreneurial motivation beyond monetary rewards
- Innovation in business and education technology
- The future of education with AI and personalised learning
Bob shares insights from his extensive career in EdTech, challenging the notion that entrepreneurs are solely motivated by money. He discusses the concept of the "donut economy" and sustainable business practices, while offering valuable perspectives on business innovation beyond just technical advancement. Bob expresses excitement about AI's potential to democratize education and bridge the gap between private tutoring and technology-enhanced learning, drawing from his experience as a former physics teacher and researcher.
Connect with Bob Gomersall on LinkedIn: https://www.linkedin.com/in/bobgomersall/
Connect with Tim Burnett on LinkedIn: https://www.linkedin.com/in/tburnett/
If you would like to join Tim on a future episode or sponsor the Test Community Network then get in touch with Tim to schedule a call: https://calendly.com/educationtech/15min-teams-chat
Events: https://www.testcommunity.network/upcoming-events
Podcasts: https://www.testcommunity.network/podcasts
Marketplace: https://www.testcommunity.network/marketplace
Subscribe to the Test Community Network here: https://www.testcommunity.network

In this week's episode, Tim Burnett discusses highlights from the Federation of Awarding Bodies (FAB) conference in Leicester and shares important updates from the assessment sector.

- Key changes to the FAB conference format, including separate awards ceremonies coming next year

- Major themes around Skills England, regulatory burden, and the evolving nature of AI in assessment

- International growth experiences shared by NEBOSH and the Chartered Management Institute

Tim provides a comprehensive overview of the FAB conference, highlighting several important developments in the assessment sector. The episode explores the significant focus on AI integration in education and assessment. Notable insights come from Deborah Gray of Hull College from a whole college perspective on AI implementation, including their AI academy and use of tools like Teach-O-Matic. The discussion touches on crucial themes of collaboration between educational bodies, the balance between personalisation and standardisation in assessment, and upcoming opportunities for funding and grants in the tech-assessment space.

Upcoming Events highlighted in the episode:

Westminster Education Forum (Dec 3) - Future of Assessment in Schools

British Expertise in India Webinars

Assessment Validation for Beginners course

STRASZ Webinar on AI in Test Development

ALT Summit on Future Leadership Skills

Academy for Assessment Multiple Choice Workshop

Education Assessment Group session with Isabel Nesbitt

The episode concludes with a touching tribute to John O'Sullivan, a beloved figure in the assessment community who passed away earlier this year.

Assessment Innovator Learner Competition | NCFEhttps://www.testcommunity.network/marketpace-details?recordId=recJT2Y9MVi2X0j7z

⚡AI Superpowers for UK Awarding Organisations⚡: https://www.testcommunity.network/test-community-network-live

Connect with Tim Burnett on LinkedIn: https://www.linkedin.com/in/tburnett/

If you would like to join Tim on a future episode or sponsor the Test Community Network then get in touch with Tim to schedule a call: https://calendly.com/educationtech/15min-teams-chat

Events: https://www.testcommunity.network/upcoming-events

Podcasts: https://www.testcommunity.network/podcasts

Marketplace: https://www.testcommunity.network/marketplace

Subscribe to the Test Community Network here: https://www.testcommunity.network

In this week's episode, Tim Burnett chats with Rebecca Conway, Director of Research Innovation at NCFE. Rebecca oversees research work, innovation, and social investments at the organisation, having joined in August.

They discuss:

- The upcoming Assessment Innovation Fund grants launching in February, partnering with UFI VocTech Trust to support assessment innovation pilots

- The major curriculum and assessment consultation, involving an independent group commissioned by the Department for Education, focusing on education from ages 4-19

- The evolution of assessment methods, including the move towards on-screen assessment by major awarding organisations by 2025-2030, and the balance between different assessment types (formative, summative, and diagnostic)

During their discussion, Rebecca shares insights about NCFE's research initiatives in labour market analysis and assessment improvements. She emphasises the importance of adapting assessment methods to mirror evolving teaching and learning practices, particularly in evaluating 21st-century skills like collaboration and communication. The conversation touches on the significant curriculum consultation, which aims to address student wellbeing, technology implementation, and creating a more flexible assessment system that serves diverse learner needs.

Rebecca discusses the potential for innovation in assessment, highlighting opportunities in AR/VR augmented learning and formative assessment tools. She also explores the balance between standardised assessment routes and more flexible options, noting the logistical challenges of implementing choice in high-volume qualifications like GCSEs and A-levels.

The episode concludes with a preview of the upcoming FAB conference and an announcement about NCFE's research grants opening in February, with associated events planned to showcase past successful projects.

Connect with Rebecca Conway on LinkedIn: https://www.linkedin.com/in/conwayrebecca/

Connect with Tim Burnett on LinkedIn: https://www.linkedin.com/in/tburnett/

If you would like to join Tim on a future episode or sponsor the Test Community Network then get in touch with Tim to schedule a call: https://calendly.com/educationtech/15min-teams-chat

Events: https://www.testcommunity.network/upcoming-events

Podcasts: https://www.testcommunity.network/podcasts

Marketplace: https://www.testcommunity.network/marketplace

Subscribe to the Test Community Network here: https://www.testcommunity.network

In this week's episode, Tim Burnett chats with Sarah Sutcliffe, co-founder of ProAssess, a consultancy supporting awarding organisations and end-point assessment organisations in qualification and assessment development. They discuss:

- ProAssess's unique training model offering year-long organisational access and monthly drop-in sessions

- Current trends in assessment organisations expanding from endpoint assessment to qualifications

- The impact of AI on assessment development and delivery

Sarah shares insights into ProAssess's two-pronged approach to supporting organisations: through consultancy services ranging from one-off calls to full project management, and their innovative online training courses. Their training model stands out by providing organisations with year-long access for all staff members, complemented by monthly Teams drop-in sessions for ongoing support and networking.

A significant focus of the discussion centres on the evolving landscape of apprenticeships and qualifications. Sarah highlights how many organisations are expanding beyond endpoint assessment into qualification offerings, driven by anticipated government changes to apprenticeship delivery, particularly at level 7. This transition presents new challenges as organisations need to develop core content and determine appropriate assessment methods independently.

The conversation also delves into the role of AI in assessment, both from development and delivery perspectives. Sarah emphasises the potential of AI tools in streamlining processes like MCQ (Multiple Choice Question) generation while stressing the continued importance of human oversight and review. She advocates for teaching AI as a valid workplace tool and incorporating it appropriately into qualifications and assessments.

Looking ahead, Sarah emphasises the importance of staying connected with industry networks, particularly with significant government decisions expected around December-January that will impact both endpoint assessment and awarding organisations.

Connect with Sarah Sutcliffe on LinkedIn: https://www.linkedin.com/in/sarah-sutcliffe/

Connect with Tim Burnett on LinkedIn: https://www.linkedin.com/in/tburnett/

If you would like to join Tim on a future episode or sponsor the Test Community Network then get in touch with Tim to schedule a call: https://calendly.com/educationtech/15min-teams-chat

Events: https://www.testcommunity.network/upcoming-events

Podcasts: https://www.testcommunity.network/podcasts

Marketplace: https://www.testcommunity.network/marketplace

Subscribe to the Test Community Network here: https://www.testcommunity.network

Register for the AI Superpowers Webinar: https://www.linkedin.com/events/aisuperpowersforukawardingorgan7256426953564418049/comments/

In this week's episode, Tim Burnett chats with Dr. Pete Atherton, an Lecturer, author, podcaster, consultant, keynote speaker and EdTech researcher and author who positions himself as an "EdTech double agent." They discuss:

Pete shares his journey from being an English teacher to becoming an EdTech researcher, highlighting his critical approach to technology implementation in education. He discusses his experience observing how tools like Kahoot were being used in classrooms - creating excitement but not necessarily meaningful learning. This led to his exploration of how to better integrate technology with teaching objectives.

The conversation delves into current developments in AI education tools, with both hosts expressing excitement about NotebookLM's capabilities, particularly its accuracy and podcast generation features. They explore the broader implications of AI in education, discussing the challenges of integration between different tools and platforms, and the need for more meaningful conversations about AI at governmental and institutional levels.

Pete also reveals his upcoming projects, including a new book focused on practical ways to use AI in the classroom, and his involvement with Eden-51, a startup breaking down English education into 51 competencies. He shares his work on developing an AI-powered creative writing coach and his research into the dialogue between humans and AI in the creative process.

The discussion concludes with reflections on the potential for AI to foster creativity and break down traditional barriers in education, while acknowledging the rapid pace of change in the field.

Connect with Pete Atherton on LinkedIn: https://www.linkedin.com/in/petefred/

Connect with Tim Burnett on LinkedIn: https://www.linkedin.com/in/tburnett/

If you would like to join Tim on a future episode or sponsor the Test Community Network then get in touch with Tim to schedule a call: https://calendly.com/educationtech/15min-teams-chat

Events: https://www.testcommunity.network/upcoming-events

Podcasts: https://www.testcommunity.network/podcasts

Marketplace: https://www.testcommunity.network/marketplace

Subscribe to the Test Community Network here: https://www.testcommunity.network

In this week's episode, Tim Burnett chats with Chelsea from Learnosity, chair of the 2024 E-ATP Conference in Berlin. They discuss her experiences at the recent E-ATP conference in Berlin and insights into the future of assessment technology.

Top 3 discussion points:

The discussion kicked off with Chelsea sharing her experiences from the E-ATP conference in Berlin. She provided detailed insights into Donald's keynote presentation, which sparked discussions about AI's role in cheating and assessment. The keynote balanced AI's positive potential while acknowledging its challenges, backed by statistical data.

Chelsea emphasized several key conference takeaways, including:

As conference chair, Chelsea brought energy and engagement to the event, including her captenciy of Team Europe in the Family Fortunes-style session that added a fun element to testing industry knowledge. She also shared exciting developments at Learnosity, where they've established an AI lab with 30 specialists working on innovations like:

The conversation concluded with Chelsea strongly endorsing volunteer roles within ATP, highlighting the professional and personal development opportunities it provides.

Connect with Chelsea on LinkedIn: https://www.linkedin.com/in/chelsea-dowd-8b382610b/

Connect with Tim Burnett on LinkedIn: https://www.linkedin.com/in/tburnett/

AI Skills Webinar: AI Superpowers for UK Awarding Organisations 21st November 2024 https://www.linkedin.com/events/aisuperpowersforukawardingorgan7256426953564418049/comments/

AI Workshop: https://www.testcommunity.network/aiworkshop

If you would like to join Tim on a future episode or sponsor the Test Community Network then get in touch with Tim to schedule a call: https://calendly.com/educationtech/15min-teams-chat

Events: https://www.testcommunity.network/upcoming-events

Podcasts: https://www.testcommunity.network/podcasts

Marketplace: https://www.testcommunity.network/marketplace

Subscribe to the Test Community Network here: https://www.testcommunity.network