AI Adoption Playbook

David Gildea has learned that traditional security models collapse when AI agents start delegating tasks to 50 or 60 other agents in enterprise workflows. As VP of Product for AI at Druva, he's building deterministic security harnesses that solve the authentication nightmare of multi-agent systems while maintaining the autonomous capabilities that make AI valuable.

David explains why MCP specifications gained faster enterprise adoption than A2A despite having weaker security features, telling Ravin how his team is addressing authentication gaps through integration with existing identity management systems like Okta. He shares Druva's approach to wrapping AI agents in security frameworks that require human approval for high-risk actions while learning from user behavior to reduce approval friction over time.

He also covers Druva's evolution from custom RAG systems to AWS Bedrock Knowledge Bases, demonstrating how to build knowing that components will be replaced by better solutions. 

Topics discussed:

Listen to more episodes: 

Apple 

Spotify 

YouTube

Website

The fastest path to production AI isn't perfect architecture, according to Alexander Page. It's customer validation. In his former role of Principal AI Architect at BigPanda, he transformed an LLM-based prototype into "Biggy," an AI system for critical incident management. BigPanda moved beyond basic semantic search to build agentic integrations with ServiceNow and Jira, creating AI that understands organizational context and learns from incident history while helping with the entire lifecycle from detection through post-incident documentation.

Alexander also gives Ravin BigPanda's framework for measuring AI agent performance when traditional accuracy metrics fall short: combine user feedback with visibility into agent decision-making, allowing operators to drag-and-drop incorrect tool calls or sequence errors. He reveals how they encode this feedback into vector databases that influence future agent behavior, creating systems that genuinely improve over time. 

Topics discussed:

Listen to more episodes: 

Apple 

Spotify 

YouTube

Website

UCHealth’s healthcare AI methodology currently enables 1 nurse to monitor 14 fall-risk patients, with plans to scale to 140, then 1,400 through computer vision and predictive analytics. Instead of exhausting pilots, they deploy in phases: test, prove, optimize, then scale. This has created a system that prioritizes force multiplication of current staff rather than replacing them, enabling healthcare professionals to work at the top of their scope.

Richard Zane, Chief Innovation Officer also tells Ravin how their computational linguistics system automatically categorizes thousands of chest X-ray incidental findings into risk levels and manages closed-loop follow-up communication, ensuring critical findings don't fall through administrative cracks. Richard's three-part evaluation framework for technology partners — subject matter expertise, technical deep dive, and financial viability — helps them avoid the startup graveyard. 

Topics discussed:

Listen to more episodes: 

Apple 

Spotify 

YouTube

Website

The construction industry sits on goldmines of unstructured data that could revolutionize how buildings get built. From thousands of contracts to communication logs spanning 12-36 month building cycles, Dan Williamson, Director of Artificial Intelligence at Ryan Companies US, says all that data remains largely untapped.

Dan walks Ravin through how Ryan is building AI systems to unlock this data, from contract risk analysis to robots doing reality capture on job sites. But the real challenge is organizational. Getting trade workers who've operated the same way for decades to embrace robotic assistants requires finding business evangelists willing to co-create change rather than having it imposed from above.

Topics discussed:

At Elastic, CISO Mandy Andress learned that pragmatic guardrails work better than blanket bans for managing AI adoption across their 3,500-person distributed workforce. Instead, she enables AI tools with smart controls rather than block them entirely.

As both a customer and provider in the AI ecosystem, Elastic faces unique challenges in AI strategy. Mandy explains how they're applying hard-learned lessons from cloud vendor lock-in to build flexible AI systems that can switch foundation models with minimal engineering effort. 

She also shares why AI ownership is naturally migrating from security teams to business units as organizations mature their understanding of the technology.

Topics discussed:

Listen to more episodes: 

Apple 

Spotify 

YouTube

Website

At Yext, evaluating every AI tool through a security-first lens sparked comprehensive AI governance frameworks that protect enterprise data without stifling productivity.

Rohit Parchuri, SVP & CISO, explains how they developed "AI fact sheets" for these evaluations, comparing each tool against specific business goals, data protection requirements, and existing capabilities. This process prevents tool duplication while ensuring security standards are met before deployment.

But governance is just one piece of Yext's AI strategy. As a company born from AI technology, they've already built their own ML models to filter false positives from security tools, and they have direct experience with AI's data amplification risks — like how incorrect restaurant ingredient data could trigger FDA issues across all client listings. Rohit explores how enterprises can build sustainable AI programs that accelerate business outcomes while maintaining robust security controls.

Topics discussed:

Listen to more episodes: 

Apple 

Spotify 

YouTube

Website

What happens when you build AI agents trusted enough to handle production incidents while engineers sleep? At Datadog, it sparked a fundamental rethink of how enterprise AI systems earn developer trust in critical infrastructure environments.

Diamond Bishop, Director of Eng/AI, outlines for Ravin how their Bits AI initiative evolved from basic log analysis to sophisticated incident response agents. By focusing first on root cause identification rather than full automation, they're delivering immediate value while building the confidence needed for deeper integration.

But that's just one part of Datadog's systematic approach. From adopting Anthropic's MCP standard for tool interoperability to implementing multi-modal foundation model strategies, they're creating AI systems that can evolve with rapidly improving underlying technologies while maintaining enterprise reliability standards.

Topics discussed:

How do you achieve 75% weekly active AI tool usage across an enterprise? At UserTesting, it started with a deliberate strategy to foster experimental adoption while maintaining governance guardrails. Michael J. Domanic, Head of Generative AI Business Strategy, tells Ravin their approach to transforming internal workflows through AI on this episode of The AI Adoption Playbook.

Rather than treating AI as purely a technical concern, UserTesting has built an impressive culture of AI adoption by empowering cross-functional teams, establishing clear usage guidelines, and meticulously tracking tangible business value. Their 800-person team has created 600 custom GPTs, many of which have transformed workflows across departments.

Michael also explores how UserTesting balanced centralized governance with democratized experimentation, their methods for measuring ROI, and why creativity — not just technical expertise — might be the critical ingredient for successful enterprise AI transformation.

Topics discussed:

When technical systems fail at companies like Netflix or Etsy, every minute of downtime can cost millions. That's why incident.io is building AI systems that can automatically investigate and diagnose technical problems faster than human engineers.

In this episode of The AI Adoption Playbook, Lawrence Jones, Product Engineer at incident.io, tells Ravin how they're creating an automated incident investigator that can analyze logs, traces, and metrics to determine what went wrong during an outage. He shares their methodical approach to AI development, focusing on measurable progress through evaluation metrics and scorecards rather than intuitive "vibe-based" changes.

Lawrence also discusses the evolution of their AI teams and roles, including their newly launched AI Engineer position designed specifically for the unique challenges of AI development, and how they use LLMs themselves to evaluate AI system performance.

Topics discussed:

Listen to more episodes: 

Apple 

Spotify 

YouTube

What happens when AI capabilities outpace organizational readiness? At Shopify, this tension has pushed them to develop a practical implementation approach that balances rapid experimentation with sustainable value creation. 

Spencer Lawrence, Director of Data Science & Engineering, shares how they've evolved from simple text expansion experiments to sophisticated AI assistants like Help Center and Sidekick that are transforming both customer support and merchant operations.

At the heart of their strategy is a barbell approach enabling self-service for small AI use cases while making targeted investments in transformative projects. Spencer also explains how their one-week sprint cycles, sophisticated evaluation frameworks, and cross-functional collaboration have helped them overcome the common challenges that prevent organizations from realizing AI's full potential.

Successful AI implementation requires more than just technical solutions — it demands new organizational structures, evaluation methods, and a willingness to constantly reevaluate what knowledge work means in an AI-augmented world.

Topics discussed:

Listen to more episodes: 

Apple 

Spotify 

YouTube