TestGuild Automation Podcast

The AI Illusion: Why Testing Still Needs Humans with Joe Colantonio


Listen Later

Everyone is talking about AI replacing testers, writing tests, and transforming software quality. But what if we're asking the wrong question?

In this solo episode, Joe Colantonio shares a growing concern he's seen while traveling across the country for TestGuild IRL events: a decline in testing fundamentals at the exact moment AI hype is reaching a fever pitch.

Drawing insights from Carissa Véliz's book Prophecy: Prediction, Power, and the Fight for the Future, Wayne Roseberry's work on AI and meaning, and Tariq King's concept of Human Experience Testing, Joe explores why AI systems may be far less intelligent than many believe, and why human testers remain more important than ever.

You'll discover:

✅ Why large language models generate plausible answers without understanding truth

✅ The difference between prediction, correlation, and genuine understanding

✅ Why AI can test software but cannot experience software

✅ What "Everything is tested, but nothing is experienced" really means

✅ How AI hype may be distracting teams from critical testing fundamentals

✅ Why empathy, context, and human judgment are becoming competitive advantages for testers

Whether you're excited about AI, skeptical of it, or somewhere in between, this episode will challenge you to think more deeply about the future of testing and your role in it.

Resources Mentioned 📖 Prophecy: Prediction, Power, and the Fight for the Future by Carissa Véliz 📖 Work and presentations by Wayne Roseberry 🎓 Free course: thebullshitmachines.com 🎤 Learn more about TestGuild IRL events: TestGuild.com/irl

If you enjoy this episode, be sure to subscribe, leave a review, and share it with a fellow tester who's trying to navigate the AI era without losing sight of the fundamentals.

#SoftwareTesting #AI #QualityEngineering #TestAutomation #SoftwareQuality #HumanExperienceTesting #ArtificialIntelligence #TestGuild #QA #TechPodcast

...more
View all episodesView all episodes
Download on the App Store

TestGuild Automation PodcastBy Joe Colantonio

  • 4.9
  • 4.9
  • 4.9
  • 4.9
  • 4.9

4.9

99 ratings


More shows like TestGuild Automation Podcast

View all
This American Life by This American Life

This American Life

91,008 Listeners

Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,108 Listeners

Planet Money by NPR

Planet Money

30,763 Listeners

Hidden Brain by Hidden Brain, Shankar Vedantam

Hidden Brain

43,614 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

623 Listeners

Frank Off The Radio: The Frank Skinner Podcast by Avalon

Frank Off The Radio: The Frank Skinner Podcast

275 Listeners

The Daily by The New York Times

The Daily

112,217 Listeners

Darknet Diaries by Jack Rhysider

Darknet Diaries

8,044 Listeners

Today, Explained by Vox

Today, Explained

10,277 Listeners

TestGuild Devops Toolchain Podcast by Joe Colantonio

TestGuild Devops Toolchain Podcast

9 Listeners

The Stack Overflow Podcast by The Stack Overflow Podcast

The Stack Overflow Podcast

64 Listeners

Huberman Lab by Scicomm Media

Huberman Lab

29,299 Listeners

The Startup Ideas Podcast by Greg Isenberg

The Startup Ideas Podcast

211 Listeners

The Rest Is Politics by Goalhanger

The Rest Is Politics

3,328 Listeners

The Rest Is Football by Goalhanger

The Rest Is Football

753 Listeners