AWS for Software Companies Podcast

Ep140: Architecting Agentic AI Systems - Technical Insights for ISVs with Anyscale, CrewAI and Encrypt AI


Listen Later

A panel discussion with AI industry leaders revealing how enterprises are scaling AI today, with predictions on coming breakthroughs for AI and the impact on Fortune 500 companies and beyond.

Topics Include:

  • Three technical leaders discuss production challenges: security, interoperability, and scaling agentic systems
  • Panelists represent Enkrypt (security), Anyscale (infrastructure), and CrewAI (agent orchestration platforms)
  • Industry moving from flashy demos to dependable agents with real business outcomes
  • Breakthrough examples include 70-page IRS form processing and multimodal workflow automation
  • Multimodal data integration becoming crucial - incorporating video, audio, screenshots into decisions
  • Less than 10% of future applications expected to be text-only
  • Companies shifting from experimenting with individual models to deploying agent networks
  • Need for governance frameworks as enterprises scale to hundreds of agents
  • Growing software stack complexity requires specialized infrastructure between applications and GPUs
  • Security teams need centralized visibility across fragmented agent deployments across enterprises
  • Existing industry regulations apply to AI services - no special AI laws needed
  • Interoperability standards debate: MCP gaining adoption while A2A seems premature solution
  • MCP shows higher API reliability than OpenAI tool calling for implementations
  • Multimodal systems more vulnerable to attacks but value proposition too high ignore
  • Fortune 500 company automated price operations approval process using 630 brands data
  • 87% of enterprise customers deploy agents in private VPCs or on-premises infrastructure
  • Specialized AI systems needed to oversee other agents at machine speed scales
  • Cost optimization through model specialization rather than always using most powerful models
  • Future learning may happen through context/prompting rather than traditional weight fine-tuning
  • Predictions include AI meeting moderators and agents working autonomously for hours


Participants:

  • Robert Nishihara - Co-founder, Anyscale
  • João Moura - CEO, CrewAI
  • Sahil Agarwal - Co-Founder & CEO, Enkrypt AI
  • Jillian D’Arcy - Sr. ISV Sales Leader, Amazon Web Services


Further Links:

  • Anyscale – Website  | LinkedIn  | AWS Marketplace
  • CrewAI - Website  | LinkedIn  | AWS Marketplace
  • Enkrypt AI - Website  | LinkedIn  | AWS Marketplace


See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/

...more
View all episodesView all episodes
Download on the App Store

AWS for Software Companies PodcastBy AWS - Amazon Web Services

  • 5
  • 5
  • 5
  • 5
  • 5

5

9 ratings


More shows like AWS for Software Companies Podcast

View all
Planet Money by NPR

Planet Money

30,727 Listeners

Hidden Brain by Hidden Brain, Shankar Vedantam

Hidden Brain

43,615 Listeners

Economist Podcasts by The Economist

Economist Podcasts

4,145 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

534 Listeners

Security Now (Audio) by TWiT

Security Now (Audio)

2,006 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,093 Listeners

CyberWire Daily by N2K Networks

CyberWire Daily

1,020 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

302 Listeners

Cybersecurity Today by Jim Love

Cybersecurity Today

179 Listeners

Practical AI by Practical AI LLC

Practical AI

205 Listeners

AWS Podcast by Amazon Web Services

AWS Podcast

205 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

519 Listeners

Cybersecurity Headlines by CISO Series

Cybersecurity Headlines

139 Listeners

Hard Fork by The New York Times

Hard Fork

5,522 Listeners

AI + a16z by a16z

AI + a16z

36 Listeners