TestGuild Automation Podcast

AI Testing: How to Ensure Quality in Non-Deterministic Systems with Adam Sandman


Listen Later

How do you ensure software quality when the system you're testing doesn't give the same output twice?

Go to https://links.testguild.com/inflectra and start your free 30-day trial, no credit card, no contract required.

That's the core challenge facing every QA team building or testing AI-powered applications today and it's breaking all the rules we've relied on for decades.

In this episode of the TestGuild Automation Podcast, I sit down with Adam Sandman, co-founder of Inflectra, to get into what non-deterministic AI testing actually means in practice, why traditional pass/fail testing no longer cuts it, and what quality professionals need to do differently right now.

We cover:

  • Why AI-generated code is raising the stakes for QA teams while budgets stay flat
  • The fundamental difference between deterministic and non-deterministic systems — and why it changes everything about how you test
  • How to set acceptable risk thresholds for AI systems (hint: it depends on whether you're building an e-commerce chatbot or an air traffic control system)
  • Why testers who embrace AI as a tool — not a threat — will be the ones leading their organizations forward
  • How a live demo failure at a conference inspired Inflectra's new non-deterministic testing tool, SureWire

If you're a tester, QA manager, or automation engineer trying to figure out how to keep up with AI-driven development without losing your mind — or your job — this one's for you.

...more
View all episodesView all episodes
Download on the App Store

TestGuild Automation PodcastBy Joe Colantonio

  • 4.9
  • 4.9
  • 4.9
  • 4.9
  • 4.9

4.9

99 ratings


More shows like TestGuild Automation Podcast

View all
This American Life by This American Life

This American Life

91,297 Listeners

Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,246 Listeners

Planet Money by NPR

Planet Money

30,609 Listeners

Hidden Brain by Hidden Brain, Shankar Vedantam

Hidden Brain

43,687 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

626 Listeners

Frank Off The Radio: The Frank Skinner Podcast by Avalon

Frank Off The Radio: The Frank Skinner Podcast

290 Listeners

The Daily by The New York Times

The Daily

113,121 Listeners

Darknet Diaries by Jack Rhysider

Darknet Diaries

8,077 Listeners

Today, Explained by Vox

Today, Explained

10,331 Listeners

TestGuild Devops Toolchain Podcast by Joe Colantonio

TestGuild Devops Toolchain Podcast

9 Listeners

The Stack Overflow Podcast by The Stack Overflow Podcast

The Stack Overflow Podcast

63 Listeners

Huberman Lab by Scicomm Media

Huberman Lab

29,272 Listeners

The Startup Ideas Podcast by Greg Isenberg

The Startup Ideas Podcast

211 Listeners

The Rest Is Politics by Goalhanger

The Rest Is Politics

3,858 Listeners

The Rest Is Football by Goalhanger

The Rest Is Football

647 Listeners