AWS for Software Companies Podcast

Ep140: Architecting Agentic AI Systems - Technical Insights for ISVs with Anyscale, CrewAI and Encrypt AI


Listen Later

A panel discussion with AI industry leaders revealing how enterprises are scaling AI today, with predictions on coming breakthroughs for AI and the impact on Fortune 500 companies and beyond.

Topics Include:

  • Three technical leaders discuss production challenges: security, interoperability, and scaling agentic systems
  • Panelists represent Enkrypt (security), Anyscale (infrastructure), and CrewAI (agent orchestration platforms)
  • Industry moving from flashy demos to dependable agents with real business outcomes
  • Breakthrough examples include 70-page IRS form processing and multimodal workflow automation
  • Multimodal data integration becoming crucial - incorporating video, audio, screenshots into decisions
  • Less than 10% of future applications expected to be text-only
  • Companies shifting from experimenting with individual models to deploying agent networks
  • Need for governance frameworks as enterprises scale to hundreds of agents
  • Growing software stack complexity requires specialized infrastructure between applications and GPUs
  • Security teams need centralized visibility across fragmented agent deployments across enterprises
  • Existing industry regulations apply to AI services - no special AI laws needed
  • Interoperability standards debate: MCP gaining adoption while A2A seems premature solution
  • MCP shows higher API reliability than OpenAI tool calling for implementations
  • Multimodal systems more vulnerable to attacks but value proposition too high ignore
  • Fortune 500 company automated price operations approval process using 630 brands data
  • 87% of enterprise customers deploy agents in private VPCs or on-premises infrastructure
  • Specialized AI systems needed to oversee other agents at machine speed scales
  • Cost optimization through model specialization rather than always using most powerful models
  • Future learning may happen through context/prompting rather than traditional weight fine-tuning
  • Predictions include AI meeting moderators and agents working autonomously for hours


Participants:

  • Robert Nishihara - Co-founder, Anyscale
  • João Moura - CEO, CrewAI
  • Sahil Agarwal - Co-Founder & CEO, Enkrypt AI
  • Jillian D’Arcy - Sr. ISV Sales Leader, Amazon Web Services


Further Links:

  • Anyscale – Website  | LinkedIn  | AWS Marketplace
  • CrewAI - Website  | LinkedIn  | AWS Marketplace
  • Enkrypt AI - Website  | LinkedIn  | AWS Marketplace


See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/

...more
View all episodesView all episodes
Download on the App Store

AWS for Software Companies PodcastBy AWS - Amazon Web Services

  • 5
  • 5
  • 5
  • 5
  • 5

5

10 ratings


More shows like AWS for Software Companies Podcast

View all
WSJ Tech News Briefing by The Wall Street Journal

WSJ Tech News Briefing

1,641 Listeners

Security Now (Audio) by TWiT

Security Now (Audio)

1,999 Listeners

SANS Internet Stormcenter Daily Cyber Security Podcast (Stormcast) by Johannes B. Ullrich

SANS Internet Stormcenter Daily Cyber Security Podcast (Stormcast)

639 Listeners

The Cloudcast by Massive Studios

The Cloudcast

156 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,080 Listeners

The Strategy Skills Podcast: Strategy | Leadership | Critical Thinking | Problem-Solving by FirmsConsulting.com & StrategyTraining.com

The Strategy Skills Podcast: Strategy | Leadership | Critical Thinking | Problem-Solving

105 Listeners

AWS Podcast by Amazon Web Services

AWS Podcast

205 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

339 Listeners

Kubernetes Podcast from Google by Abdel Sghiouar, Kaslin Fields

Kubernetes Podcast from Google

182 Listeners

Practical AI by Practical AI LLC

Practical AI

206 Listeners

Morning Brew Daily by Morning Brew

Morning Brew Daily

2,986 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,635 Listeners

Cyber Security Headlines by CISO Series

Cyber Security Headlines

134 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

551 Listeners

HBR On Leadership by Harvard Business Review

HBR On Leadership

164 Listeners