TestGuild Automation Podcast

AI Testing LLMs & RAG: What Testers Must Validate with Imran Ali


Listen Later

AI is transforming how software is built, but testing AI systems requires an entirely new mindset.

Don't miss AutomationGuild 2026 - Register Now: https://testguild.me/podag26

Use code TestGuildPod20 to get 20% off your ticket.

In this episode, Joe Colantonio sits down with Imran Ali to break down what AI testing really looks like when you're dealing with LLMs, RAG pipelines, and autonomous QA workflows.

You'll learn:

Why traditional pass/fail testing breaks down with LLMs

How to test non-deterministic AI outputs for consistency and accuracy

Practical techniques for detecting hallucinations, grounding issues, and prompt injection risks

How RAG systems change the way testers validate AI-powered applications

Where AI delivers quick wins today—and where human validation still matters

This conversation goes beyond hype and gets into real-world AI testing strategies QA teams are using right now to keep up with AI-generated code, faster release cycles, and DevOps velocity.

If you're a tester, automation engineer, or QA leader wondering how AI changes your role,not replaces it,this episode is your roadmap.

...more
View all episodesView all episodes
Download on the App Store

TestGuild Automation PodcastBy Joe Colantonio

  • 4.9
  • 4.9
  • 4.9
  • 4.9
  • 4.9

4.9

99 ratings


More shows like TestGuild Automation Podcast

View all
Software Engineering Radio - the podcast for professional software developers by team@se-radio.net (SE-Radio Team)

Software Engineering Radio - the podcast for professional software developers

271 Listeners

The Changelog: Software Development, Open Source by Changelog Media

The Changelog: Software Development, Open Source

290 Listeners

WSJ Tech News Briefing by The Wall Street Journal

WSJ Tech News Briefing

1,640 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

623 Listeners

The Cloudcast by Massive Studios

The Cloudcast

151 Listeners

Thoughtworks Technology Podcast by Thoughtworks

Thoughtworks Technology Podcast

43 Listeners

Python Bytes by Michael Kennedy and Brian Okken

Python Bytes

215 Listeners

Data Engineering Podcast by Tobias Macey

Data Engineering Podcast

146 Listeners

AI Today Podcast by AI & Data Today

AI Today Podcast

152 Listeners

Tech Brew Ride Home by Morning Brew

Tech Brew Ride Home

960 Listeners

Practical AI by Practical AI LLC

Practical AI

207 Listeners

TestGuild Devops Toolchain Podcast by Joe Colantonio

TestGuild Devops Toolchain Podcast

9 Listeners

The Stack Overflow Podcast by The Stack Overflow Podcast

The Stack Overflow Podcast

63 Listeners

The Real Python Podcast by Real Python

The Real Python Podcast

141 Listeners

TestGuild News Show by Joe Colantonio

TestGuild News Show

1 Listeners