Deployed: The AI Product Podcast

Building Enterprise-Grade AI Agents: Lessons from Sierra's Arya Asemanfar


Listen Later

In this episode, we sit down with Arya Asemanfar, Product and Engineering leader at Sierra, to explore the future of AI-powered enterprise agents. Arya breaks down how Sierra is transforming customer experiences by building agents that go beyond traditional chatbots—taking meaningful actions, embodying brand voice, and scaling reliably for unique business needs.

Learn how Sierra approaches agent development with their innovative “Agent OS,” solves challenges like tool hallucination, and co-designs solutions with customers. Arya also shares actionable insights for product and engineering leaders, from building better evaluation systems to designing intuitive feedback loops.

Topics covered in this episode:

What Are Enterprise Agents?

  • The difference between traditional chatbots and AI-powered agents that take meaningful actions.
  • Examples of how Sierra’s agents transform customer service interactions (e.g., returns, exchanges).

Building Scalable AI Agents

  • The importance of robust architecture for reliability and performance.
  • How Sierra’s “Agent OS” supports the full lifecycle of agent development—from design to monitoring.
  • Addressing tool hallucination and ensuring agents only take actionable, reliable steps.
  • Using evaluation frameworks to test and refine agent behavior at scale.

Collaborating with Customers

  • Why each agent is treated as a unique product tailored to a customer’s brand, policies, and processes.
  • The co-design process and how it ensures agents align with business needs.

Actionable Advice for Teams Building AI Agents

  • Start with concrete customer examples to develop intuition and build better agents.
  • Implement evaluation systems early to accelerate learning and iteration.
  • Invest in tools and processes to streamline human feedback and testing.

The Future of AI and Product Design

  • Emerging paradigms that will transform how users interact with software.
  • Predictions for how AI will shape new user experiences beyond automation.
...more
View all episodesView all episodes
Download on the App Store

Deployed: The AI Product PodcastBy Freeplay

  • 5
  • 5
  • 5
  • 5
  • 5

5

8 ratings


More shows like Deployed: The AI Product Podcast

View all
Uncomfortable Conversations with Josh Szeps by Josh Szeps

Uncomfortable Conversations with Josh Szeps

842 Listeners

The Daily by The New York Times

The Daily

112,342 Listeners

Syntax - Tasty Web Development Treats by Wes Bos & Scott Tolinski - Full Stack JavaScript Web Developers

Syntax - Tasty Web Development Treats

985 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,074 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,852 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

500 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

476 Listeners

Hard Fork by The New York Times

Hard Fork

5,471 Listeners

Prof G Markets by Vox Media Podcast Network

Prof G Markets

1,340 Listeners