Shifting Schools: Conversations for K12 Educators

AI Companions: the risks and benefits, and what educators need to know


Listen Later

How do we prepare students—and ourselves—for a world where AI grief companions and "deadbots" are a reality?

In this eye-opening episode, Jeff Utecht sits down with Dr. Tomasz Hollanek, a critical design and AI ethics researcher at the University of Cambridge's Leverhulme Centre for the Future of Intelligence, to discuss:

  • The rise of AI companions like Character.AI and Replika

  • Emotional manipulation risks and the ethics of human-AI relationships

  • What educators need to know about the EU AI Act and digital consent

  • How to teach AI literacy beyond skill-building—focusing on ethics, emotional health, and the environmental impact of generative AI

  • Promising examples: preserving Indigenous languages and Holocaust survivor testimonies through AI

From griefbots to regulation loopholes, Tomasz explains why educators are essential voices in shaping how AI unfolds in schools and society—and how we can avoid repeating the harms of the social media era.

Dr Tomasz Hollanek is a Postdoctoral Research Fellow at the Leverhulme Centre for the Future of Intelligence (LCFI) and an Affiliated Lecturer in the Department of Computer Science and Technology at the University of Cambridge, working at the intersection of AI ethics and critical design. His current research focuses on the ethics of human-AI interaction design and the challenges of developing critical AI literacy among diverse stakeholder groups; related to the latter research stream is the work on AI, media, and communications that he is leading at LCFI.

Connect with him:

https://link.springer.com/article/10.1007/s13347-024-00744-w

https://www.repository.cam.ac.uk/items/d3229fe5-db87-42ff-869b-11e0538014d8

https://www.desirableai.com/journalism-toolkit

📌 Key Takeaways
  • Teenagers are vulnerable AI users. Many systems simulate empathy while bypassing meaningful regulation or safeguards.

  • Consent needs a redesign. Hollanek proposes recurring consent mechanisms—a shift from passive pop-ups to informed, adaptive engagement.

  • AI literacy ≠ prompt engineering. We must move from tool proficiency to critical awareness of data footprints, systemic manipulation, and long-term impact.

  • Social AI is the new social media. Without thoughtful intervention, the pitfalls of social media could repeat—and intensify—with AI companions.

  • AI for cultural preservation. Ethical use of AI offers promise for sustaining languages and stories that might otherwise disappear.

🧠 For Educators: Use This Episode To
  • Spark classroom discussions on ethics, digital legacy, and emotional AI

  • Reflect on policy decisions around edtech adoption and student data consent

  • Explore speculative design as a student project to imagine future AI uses and risks

  • Guide students in analyzing AI's impact on mental health and community memory

Thank you to our show sponsor, Alongside.

Learn more about their critical research:

Inside the report: > Teens are struggling with sleep more than ever > School-life balance feels out of reach at every age > Boys are looking for new ways to ask for help > Confidential, self-guided tools are resonating deeply with students.

https://www.alongside.care/shifting?utm_campaign=Shifting

...more
View all episodesView all episodes
Download on the App Store

Shifting Schools: Conversations for K12 EducatorsBy Jeff Utecht & Tricia Friedman

  • 4.9
  • 4.9
  • 4.9
  • 4.9
  • 4.9

4.9

41 ratings


More shows like Shifting Schools: Conversations for K12 Educators

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,120 Listeners

Happier with Gretchen Rubin by Gretchen Rubin / The Onward Project

Happier with Gretchen Rubin

12,899 Listeners

The Cult of Pedagogy Podcast by Jennifer Gonzalez

The Cult of Pedagogy Podcast

2,416 Listeners

Up First from NPR by NPR

Up First from NPR

56,439 Listeners

The Diary Of A CEO with Steven Bartlett by DOAC

The Diary Of A CEO with Steven Bartlett

8,609 Listeners

Crime Junkie by audiochuck

Crime Junkie

368,592 Listeners

Today, Explained by Vox

Today, Explained

10,228 Listeners

Worklife with Adam Grant by TED

Worklife with Adam Grant

9,193 Listeners

Dateline NBC by NBC News

Dateline NBC

47,858 Listeners

The Happiness Lab with Dr. Laurie Santos by Pushkin Industries

The Happiness Lab with Dr. Laurie Santos

14,380 Listeners

Science of Reading: The Podcast by Amplify Education

Science of Reading: The Podcast

659 Listeners

Consider This from NPR by NPR

Consider This from NPR

6,380 Listeners

A Bit of Optimism by Simon Sinek

A Bit of Optimism

2,118 Listeners

IMO with Michelle Obama and Craig Robinson by Higher Ground

IMO with Michelle Obama and Craig Robinson

12,602 Listeners

ReThinking by TED

ReThinking

634 Listeners