The Road to Accountable AI

Venkat Siva (Compfly): Governing Agents at the Execution Boundary


Listen Later

Kevin Werbach speaks with Venkat Siva, co-founder and CEO of CompFly AI, about why governing autonomous agents requires a fundamentally different approach than securing traditional software. Siva argues that agents create a genuinely new control problem. Because they decide at runtime which tools to call and which actions to take, governance cannot simply be bolted onto existing MLOps or security platforms built for fixed, deterministic workflows. Instead, control has to move to the "execution boundary" — the point where an agent's decision turns into a real-world action. And agent safety is much more than just model safety.

In practical terms, Siva makes the case for giving every enterprise agent a distinct, cryptographically verifiable identity using decentralized identifiers (DIDs) and verifiable credentials. He addresses the growing problem of "shadow agents," pointing to employees experimenting with powerful open-source autonomous tools inside enterprises, and explains discovery techniques like intercepting traffic to model APIs and watching for who requests LLM keys. He offers the concept of an "autonomy budget": classify actions by reversibility and financial, regulatory, and customer impact, so an agent might autonomously issue a small refund but require human approval for a large one. Drawing on his time at the electric automaker Rivian, Siva closes by contrasting recoverable digital failures with the irreversible stakes of agents embedded in physical systems, arguing that governance there must borrow from safety engineering.

Venkat Siva is the co-founder and CEO of CompFly AI, an early-stage company building a control plane to discover, validate, secure, and govern autonomous agents from code to production. Before founding CompFly with Anand Salodkar, he spent more than two decades building enterprise platform products that help organizations adopt new technology safely and at scale, including work at the electric vehicle maker Rivian. Transcript

The Architecture of Trust (Compfly Manifesto) CoSAI Model Context Protocol Security white paper

...more
View all episodesView all episodes
Download on the App Store

The Road to Accountable AIBy Kevin Werbach

  • 5
  • 5
  • 5
  • 5
  • 5

5

24 ratings


More shows like The Road to Accountable AI

View all
WSJ What’s News by The Wall Street Journal

WSJ What’s News

4,373 Listeners

The Daily by The New York Times

The Daily

112,225 Listeners

Up First from NPR by NPR

Up First from NPR

56,639 Listeners

Practical AI by Practical AI LLC

Practical AI

214 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,256 Listeners

Your Undivided Attention by The Center for Humane Technology, Tristan Harris, Aza Raskin

Your Undivided Attention

1,620 Listeners

All Things Sustainable by S&P Global

All Things Sustainable

59 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

566 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

510 Listeners

Hard Fork by The New York Times

Hard Fork

5,560 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,339 Listeners

The Weekly Show with Jon Stewart by Comedy Central

The Weekly Show with Jon Stewart

10,853 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

691 Listeners

The AI Policy Podcast by Center for Strategic and International Studies

The AI Policy Podcast

47 Listeners

I've Got Questions with Sinead Bovell by Sinead Bovell

I've Got Questions with Sinead Bovell

39 Listeners