Sign up to save your podcasts
Or
Share Unit Tests Won't Save You: Testing Agentic AI in the Enterprise
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Unit Tests Won't Save You: Testing Agentic AI in the Enterprise
Enterprise testing frameworks were not built for agents that plan, remember, and make decisions across multi-step pipelines. This episode covers why unit tests fail for agentic systems, how to design evaluation frameworks for non-deterministic behavior, what tools like Ragas, LangSmith, and PromptFoo actually test, and the architectural patterns — sandboxing, canary agents, shadow mode — that make production-safe agentic AI possible.
View all episodes
By Srini KarlekarEnterprise testing frameworks were not built for agents that plan, remember, and make decisions across multi-step pipelines. This episode covers why unit tests fail for agentic systems, how to design evaluation frameworks for non-deterministic behavior, what tools like Ragas, LangSmith, and PromptFoo actually test, and the architectural patterns — sandboxing, canary agents, shadow mode — that make production-safe agentic AI possible.