BONUS EPISODE ! We'd love to meet more of our listeners in person, so here's a list of events over the next few weeks when Dan, Ray, or Dan and Ray are speaking about AI in Education. One of the things that makes the podcast special is the amazing stories we get from our guests, and there's more stories than fit into an episode, and we're always on the lookout for more. So come and say hi at any of these events, and per   haps we can share an untold story, or you can tell us yours!

August 

19 August - Melbourne - Ray

Melbourne EdTech Summit

Ray's on the panel discussing "The Transformed Learning Landscape Through AI" at this event for edtech companies and universities

21 August - Sydney - Ray - Free event

The Future of Human AI - IATD

If you're in Sydney, the Institute of Applied Technology has scheduled the perfect event on Wednesday evening (starting at 6PM). Ray's hosting the free learning session "The Future of Human AI", designed for the thousands of small businesses and employees around Western Sydney who want to make sense of the AI hype and start to understand what everybody else is talking about. If you're a teacher, you'll also walk away with some good ideas of how businesses are using AI to help with your discussion of AI in the classroom

 

23 August - Sydney - Dan

AI in Education Conference | Teaching Tomorrow: Harnessing AI Tools Today

Organised by friends of the podcast Matt Esterman and Nick Jackson at WSU's Parramatta campus, it'll be a festival of ideas from a great lineup of teachers. Dan's one of the speakers, and will be wearing his Microsoft badge on the day, talking about all the latest great tech announcements from that world.

 

September

3 September - Online - Dan - Free event

Build a Bot in Copilot Studio

Doing his day job, Dan's taking part in this online workshop designed to help Microsoft Copilot users build their own bot. Like Build a Bear workshop, but with less bear and more bot. Open to any Microsoft customers in Australia and New Zealand.

 

4 September - Christchurch, NZ - Ray

NZ Tertiary ICT Conference

For New Zealand listeners Ray's heading over the ditch to deliver a keynote called "AI, why?" at the annual conference for digital teams of universities and polytechnics. If you're going to be there, please say Hi!

 

12-13 September - Adelaide - Ray

HE FEST 24

Ray's taking part in the "Marketing, Recruitment, Advancement and AI in Higher Education Conference" in Adelaide. Ray's on a panel discussion "The place of AI in university " with Eddie Major, on applications of AI beyond teaching and learning, and then delivering the closing keynote, grandly titled "The future of HE - The future of higher education in a world where gen AI is ubiquitous"

 

16-19 September - Online - Dan and Ray - Free event

Toddle's AI for AussieEd online event 

The toddle team have pulled together 20 speakers from across Australia, who will be talking about assessment, LMSs, chatbots, the AI Framework for schools, leadership and data-driven learning. And tacked on right at the end of the run, at 5:15 on the 19th, we're going to have a crack at a live podcast recording

 

In this episode of the AI in Education podcast, hosts Dan and Ray welcome Amanda Bickerstaff, an experienced educator, keynote speaker, researcher, and founder of AI for Education. Amanda shares her journey from traditional teaching to embracing AI during her time in Australia and the US. She explains the transformative potential of generative AI in creating rubrics and personalizing learning while highlighting the current limitations and necessary steps toward adoption. Amanda advocates for building AI literacy, addressing teacher fears and misconceptions, and embracing creativity. The discussion also explores the future of AI in education, particularly in personalised tutoring, and the importance of understanding biases and data privacy. Amanda emphasises meeting educators where they are and the potential of AI in saving time and enhancing teaching practices.

Amanda's LinkedIn Profile: Amanda Bickerstaff | LinkedIn AI for Education site: AI for Education AI prompt library: Prompt Library  Webinar archive: AI Webinars for Educators Free resources for teachers: Downloadable Resources

00:00 Guest Introduction: Amanda Bickerstaff 01:17 Amanda's Background and Journey 02:53 The Role of AI in Education 04:56 Challenges and Misconceptions in AI Adoption 06:05 Building AI Literacy and Addressing Fears 12:51 The Future of Personalised Learning 22:13 Exciting Developments and Final Thoughts 30:29 Conclusion and Closing Remarks

Holy smokes, we missed the party that should have been Episode 100! So now we're going to have a belated party episode later. Oh well, this week's episode is not to be stopped, so yet again Dan and Ray discuss the most interesting research on the use of AI in Education from the recent publications. But before that we started with a quick news summary. All the links are here:

News

California’s proposed law against AI replacing human professors

https://www.universityworldnews.com/post.php?story=20240702214317879

 

Animated AI Teaching Assistants Coming to Morehouse

https://www.insidehighered.com/news/tech-innovation/artificial-intelligence/2024/07/09/animated-ai-tas-are-coming-morehouse

 

Khanmigo for all!

https://x.com/khanacademy/status/1813665014911316237

Sign up for Khanmigo for Teachers in English: blog.khanacademy.org/khanmigo-world

 

Open AI https://techcrunch.com/2024/08/07/this-week-in-ai-openais-talent-retention-woes/

Research Papers

SUMMATIVE EXAMS WITH THE USE OF CHATGPT: VISION OR REALISTIC ALTERNATIVE TO TRADITIONAL EXAMS?

https://library.iated.org/view/BAUME2024SUM

Note that this paper is one of the few that I'll flag that's behind a journal paywall. If you don’t have access, I'd suggest asking the author, Matthias Baume from TUM, if he's happy to share a copy

 

 

The great detectives: humans versus AI detectors in catching large language model-generated medical writing

https://edintegrity.biomedcentral.com/articles/10.1007/s40979-024-00155-6

Jae Q. J. Liu, Kelvin T. K. Hui, Fadi Al Zoubi, Zing Z. X. Zhou, Curtis C. H. Yu, Jeremy R. Chang, Arnold Y. L. Wong - The Hong Kong Polytechnic University

Dino Samartzis, Rush University Medical Center

 

 

Leveraging Large Language Model as Simulated Patients for Clinical Education

https://arxiv.org/abs/2404.13066

Yanzeng Li1 , Cheng Zeng2,3 , Jialun Zhong1 , Ruoyu Zhang1 , Minhao Zhang1 , Lei Zou1∗ 1Wangxuan Institute of Computer Technology, Peking University 2School of Computer Science, Wuhan University. 3CureFun Co.

 

 

Automated Assessment of Encouragement and Warmth in Classrooms Leveraging Multimodal Emotional Features and ChatGPT

https://arxiv.org/abs/2404.15310

 

 

"ChatGPT Is Here to Help, Not to Replace Anybody" -- An Evaluation of Students' Opinions On Integrating ChatGPT In CS Courses

https://arxiv.org/abs/2404.17443

Bruno Pereira Cipriano and Pedro Alves

Lusofona University, COPELABS, Lisbon, Portugal

 

 

Math Multiple Choice Question Generation via Human-Large Language Model Collaboration

https://arxiv.org/abs/2405.00864

Jaewook Lee, Andrew Lan - University of Massachusetts Amherst

Digory Smith, Simon Woodhead -  Eedi

 

 

ChatGPT in Data Visualization Education: A Student Perspective

https://arxiv.org/abs/2405.00748

Nam Wook Kim, Grace Myers - Boston College; Hyung-Kwon Ko - KAIST; Benjamin Bach - INRIA

 

 

A Careful Examination of Large Language Model Performance on Grade School Arithmetic

https://arxiv.org/abs/2405.00332

 

 

Automated Generation of High-Quality Medical Simulation Scenarios Through Integration of Semi-Structured Data and Large Language Models

https://arxiv.org/abs/2404.19713

Scott Sumpter CHSOS, Canadian Surgical Technology and Advanced Robotics, London Health Sciences Centre

 

 

Outsmarting Artificial Intelligence in the Classroom—Incorporating Large Language Model-Based Chatbots into Teaching

https://publications.aaahq.org/iae/article/doi/10.2308/ISSUES-2023-064/12560

Juliane Wutzler, Worms University of Applied Sciences

 

 

University Students’ Self-Reported Reliance on ChatGPT for Learning: a Latent Profile Analysis

https://www.sciencedirect.com/science/article/pii/S2666920X24000468

Ana Stojanov, Qian Liu , Joyce Hwee Ling Koh - University of Otage

 

This episode of the AI in Education podcast features an interview with Anthony England, the Director of Innovative Learning Technologies at Pymble Ladies College in Sydney.

Anthony, known for his impressive shirt collection and his kind-hearted approach to education, shares his insights on the challenges and opportunities presented by AI in assessment and personalisation of the learning experience for students.

Anthony shares his vision for AI-driven personalised tutors, and how AI can assist in providing contextual and personalised feedback to students. We also cover the role of AI in helping teachers manage their workload and provide timely feedback.

When we get onto the community of learning, we hear about Anthony's AI-driven agenda to better connect with parents, and bringing them into the community of learning - they become engaged rather than merely recipients of messages.

Anthony talked about some of the events where he's a speaker, and the next ones to look out for him at are:

• EduTech Expo, in Melbourne on 14th AugustThe Educator to Entrepreneur pipeline: Making your idea a solution
• The AI in Education Conference, at Western Sydney University on 23rd AugustAI in Education Conference | Teaching Tomorrow: Harnessing AI Tools Today

 

 

In this episode Dan and Ray speak to Michelle Michael and Dan Hart from the New South Wales Department of Education about their world leading trial of AI, called NSWEduChat. 

 

Michelle is the NSW Department of Education Director: Education Support, Rural Initiatives and Gen AI. Her LinkedIn profile is here.

 

Dan is the Head of AI at the NSW DoE. His LinkedIn profile is here

 

Some of the resources that the team talked about in the episode are below:

 

NSWEduChat landing page: NSWEduChat

 

NSW Department of Education: AI in Education - Artificial intelligence in education (nsw.gov.au)

 

NSW Department of Education: Guidelines regarding the use of generative AI: Guidelines regarding the use of generative AI (nsw.gov.au)

 

Safeguard personal information: Manage personal information effectively and de-identify it to protect privacy.

 

Techniques for de-identification: Use data anonymization and masking to remove or alter personal information.

 

Verify and edit AI content: Ensure accuracy and suitability of AI-generated content, aligning with ethical principles, teaching standards and quality teaching.

 

Stay up-to-date with training: Attend training and professional learning on cybersecurity, data breach response, and child protection.

 

Use effective prompting: Create clear and specific prompts to improve the quality and relevance of AI-generated output.

 

Future Frontiers - Education for an AI world: e-book: Future Frontiers e-book

 

NSW DoE Future Frontiers landing page: Education for a Changing World

From AI Detectors to Heartwarming Help: Two Tales of AI in a school

Series 8 Episode 11 

In this episode of the AI in Education podcast, hosts Ray Fleming and Dan Bowen interview Martin O'Sullivan, a UK headteacher and lifelong friend of Dan. They talk about two contrasting stories from Martin's school—one highlighting the frustration in the application of AI when students were accused of cheating, and the other illustrating the compassionate use of AI to help a student undergoing cancer treatment participate in classes remotely via an AI-enabled robot. The discussion emphasises the complexities and ethical considerations of integrating AI in education. 

00:00 Introduction 

02:32 Martin's Background and School 

03:50 AI in Education: Martin's Journey

05:59 Challenges with AI Detectors

09:23 Emotional Impact on Students

11:45 Reflections on AI in Assessment

We discussed two assessment topics that have been in previous episodes:

• Sydney University's approach to assessment with Lane 1 and Lane 2 assessments - in Series 8 Episode 2
• The AI Assessment Scale research - in Series 8 Episode 7

22:34 Heartwarming Story: AI Robot for Student

There's more reporting on this story on the BBC website

27:10 Conclusion and Final Thoughts

Another episode rounding up the latest news and research on AI in Education. The links below go straight to all the news stories and research papers discussed this week

 

NEWS Victorian "Generative Artificial Intelligence Policy" for government schools.

https://www2.education.vic.gov.au/pal/generative-artificial-intelligence/policy

 

Meeting the AI Skills Boom

https://techcouncil.com.au/wp-content/uploads/Meeting-the-AI-Skills-Boom-2024.v2.pdf

 

LAUSD shelves its hyped AI chatbot to help students after collapse of firm that made it

https://www.latimes.com/california/story/2024-07-03/lausds-highly-touted-ai-chatbot-to-help-students-fails-to-deliver

 

A class above: UNSW Sydney uses AI to power personalised paths to student success

https://news.microsoft.com/en-au/features/a-class-above-unsw-sydney-uses-ai-to-power-personalised-paths-to-student-success/

 

 

Research Detecting ChatGPT-Generated Essays in a Large-Scale Writing Assessment: Is There a Bias Against Non-Native English Speakers?

https://www.sciencedirect.com/science/article/abs/pii/S0360131524000848#bib23

 

GenAI Detection Tools, Adversarial Techniques and Implications for Inclusivity in Higher Education

https://arxiv.org/abs/2403.19148

 

Avoiding embarrassment online: Response to and inferences about chatbots when purchases activate self-presentation concerns

https://myscp.onlinelibrary.wiley.com/doi/10.1002/jcpy.1414

 

Navigating the Ethical Landscape of Multimodal Learning Analytics: A Guiding Framework

https://osf.io/preprints/edarxiv/adxuq

 

How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responses

https://arxiv.org/pdf/2405.00970

 

AI Conversational Agent Design for Supporting Learning and Well-Being of University Students

https://osf.io/preprints/edarxiv/w4rtf

 

The Neglected 15%: Positive Effects of Hybrid Human-AI Tutoring Among Students with Disabilities

https://osf.io/preprints/edarxiv/y52ew

 

The GPT Surprise: Offering Large Language Model Chat in a Massive Coding Class Reduced Engagement but Increased Adopters Exam Performances

https://osf.io/preprints/osf/qy8zd

 

The Future of Feedback: Integrating Peer and Generative AI Reviews to Support Student Work

https://osf.io/preprints/edarxiv/x3dct

 

Is ChatGPT Transforming Academics' Writing Style?

https://arxiv.org/abs/2404.08627

 

Can AI Provide Useful Holistic Essay Scoring?

https://osf.io/preprints/osf/7xpre

Read the excellent article about this paper in the Heching Report

 

Best Practices for Using AI When Writing Scientific Manuscripts

https://pubs.acs.org/doi/epdf/10.1021/acsnano.3c01544

 

A real-world test of artificial intelligence infiltration of a university examinations system: A “Turing Test” case study

https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0305354

Continuing our Series 8, focused on the topic of assessment, and the impact of AI, roving reporter Ray visits Fitzroy, Victoria, to interview Dan Ingvarson, a notable founder and executive consultant in the field of AI in education, whilst co-host Dan (Welsh Dan?) joins remotely. Dan (Ingvarson) discusses his background and extensive work in AI policy and education technology, touching upon his involvement in various global initiatives including the Edsafe Alliance and Educational Services Australia. The conversation looks into the complexities of modern educational assessment, focusing on how generative AI can transform traditional assessment practices. He highlights the obstacles teachers face with current assessment methods and how AI could help alleviate some of these challenges by offering more personalised and authentic evaluations. The podcast also touches on the potential for AI to support teachers in creating effective rubrics and improving the overall quality of education through better data analytics. Ray and (Welsh) Dan emphasise the importance of evolving curricula to incorporate these advanced AI methodologies while discussing broader implications for student learning and teacher workload.   00:00 Introduction and Welcome 00:47 Meet Dan Ingvarsson: AI Guru 02:26 The Evolution of AI in Education 03:46 Deep Dive into Assessment 06:46 Challenges and Opportunities in AI-Assisted Assessment 19:21 Ensuring Authenticity in Student Work 23:28 Future of AI in Education 31:31 Practical Tips for Teachers 33:47 Conclusion and Final Thoughts

Content warning! This episode talks about an academic research paper titled "ChatGPT is bulls**t", and we've not edited the word out - in fact, we've gone to town with it, talking about the different types of it (in the strictest academic sense). So you may not want to play this in the car on your school run!

The news item discussed is:

Student crafts elaborate AI scheme to pass university exam, gets arrested

https://cybernews.com/news/turkish-student-found-using-ai-arrested/

 

This week's papers discussed are:

Developing evaluative judgement for a time of generative artificial intelligence

https://www.tandfonline.com/doi/full/10.1080/02602938.2024.2335321

 

Prompting Large Language Models for Zero-shot Essay Scoring via Multi-trait Specialization

https://arxiv.org/abs/2404.04941

 

Working Alongside, Not Against, AI Writing Tools in the Composition Classroom: a Dialectical Retrospective

https://uen.pressbooks.pub/teachingandgenerativeai/chapter/working-alongside-not-against-ai-writing-tools-in-the-composition-classroom-a-dialectical-retrospective/

 

GPT versus Resident Physicians — A Benchmark Based on Official Board Scores

https://ai.nejm.org/doi/pdf/10.1056/AIdbp2300192

 

Evaluating General Vision-Language Models for Clinical Medicine

https://www.medrxiv.org/content/10.1101/2024.04.12.24305744v1

 

Re-evaluating GPT-4’s bar exam performance

https://link.springer.com/article/10.1007/s10506-024-09396-9

 

Automated Social Science: Language Models as Scientist and Subjects

https://arxiv.org/abs/2404.11794

 

Large language models cannot replace human participants because they cannot portray identity groups

https://arxiv.org/abs/2402.01908

 

I also mentioned the article about the the Infinite Focus Group, which is here:

https://www.ai-mindset.ai/ai-mindset-newsletter/the-infinite-focus-group

 

The impact of large language models on university students’ literacy development

https://www.tandfonline.com/doi/epdf/10.1080/07294360.2024.2332259?needAccess=true

 

Do teachers spot AI? Evaluating the detectability of AI-generated texts among student essays

https://www.sciencedirect.com/science/article/pii/S2666920X24000109

 

Feedback sources in essay writing: peer-generated or AI-generated feedback?

https://link.springer.com/article/10.1186/s41239-024-00455-4

 

ChatGPT is bullshit

https://link.springer.com/epdf/10.1007/s10676-024-09775-5?sharing_token=0CIhP_zo5-plierRq8kkDPe4RwlQNchNByi7wbcMAY77xTOWyddkW01qGFs1m5zuuoZGBctVlsJF8SbYqcxWi-XzgEYEPiw7xwWi4bMYXJ_1JARDrER9JGdWZOW-UGSkrk_tXPjPh-XWvFNoiFzNlnDUUUEBAztiX9PtP2p6jfI%3D

Wow, this week we have a bumper episode with more resources than a GPT factory!  Any time we get a guest making their second appearance, and therefore enter our Hall of Fame, then we officially dub them "Friend of the Show". And so this week, we've got Friend of the Show Leon Furze sharing his experiences and expertise.

 

Here are the links and posts related to our conversation with Leon around assessment.  

 

Leon's blog - for all the updates and posts that he is working on  https://leonfurze.com/blog 

 

Leons's free e-Book on assessment can be found here: https://mailchi.mp/leonfurze/assessment (free ebook on assessment)

 

Leon Furze Linkedin profile is here if you want to follow his stream of thoughts, and to connect with him: Leon Furze - Furze Smith Consulting | LinkedIn

 

The Artificial Intelligence Assessment Scale (AIAS) paper we discussed can be found here:  https://open-publishing.org/journals/index.php/jutlp/article/view/810 

 

The online course around practical AI strategies:

https://practicalaistrategies.com/p/practical-ai-strategies 

And, even better, he's given listeners a discount code that will save you 25% of the cost. Just use the magic word 'AIPODCAST'

 

The blog post we mentioned a couple of times during the episode:

https://leonfurze.com/2024/05/27/dont-use-genai-to-grade-student-work/

 

Leons new book and course can be also found on his main site here:

https://practicalaistrategies.com/