IT Visionaries

90% of AI Demos Fail. Here’s How to Build One that Won’t


Listen Later

If you’ve ever shipped an AI feature that looked great in testing — only to watch it behave unpredictably in production — you’re not alone.

In this episode of IT Visionaries, host Chris Brandt talks with Lawrence Jones, Founding Engineer at incident.io, about the critical gap between AI that demos well and AI that works under pressure. Lawrence shares how his team designs tools that help engineers respond faster, learn from failure, and build systems that don’t crumble when it counts.

 

CHAPTERS / KEY MOMENTS

00:00 - AI Chaos & The Mike Tyson Rule

00:58 - Meet Lawrence Jones of Incident.io

03:14 - From FinTech Outages to Incident Response

06:22 - The Biggest Mistake in Incident Management

09:08 - Training for Chaos: Game Day Simulations

10:31 - Inside the AI SRE System

13:01 - What SRE Really Means

16:23 - From Prototype to Production AI

20:27 - Keeping Up with AI’s Rapid Evolution

22:50 - Understanding Vector Databases & Embeddings

28:34 - The Architecture Problem: Chaining Prompts at Scale

36:11 - Measuring AI Performance & Reliability

44:02 - The Future of SRE Meets AI

52:10 - Lessons from Real Incidents

56:42 - Final Thoughts: Building AI That Works

-- 

This episode of IT Visionaries is brought to you by Meter - the company building better networks. Businesses today are frustrated with outdated providers, rigid pricing, and fragmented tools. Meter changes that with a single integrated solution that covers everything wired, wireless, and even cellular networking. They design the hardware, write the firmware, build the software, and manage it all so your team doesn't have to.

That means you get fast, secure, and scalable connectivity without the complexity of juggling multiple providers. Thanks to meter for sponsoring. Go to meter.com/itv to book a demo.

---

IT Visionaries is made by the team at Mission.org. Learn more about our media studio and network of podcasts at mission.org.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

...more
View all episodesView all episodes
Download on the App Store

IT VisionariesBy Mission

  • 4.6
  • 4.6
  • 4.6
  • 4.6
  • 4.6

4.6

170 ratings


More shows like IT Visionaries

View all
This Week in Startups by Jason Calacanis

This Week in Startups

1,290 Listeners

WSJ Tech News Briefing by The Wall Street Journal

WSJ Tech News Briefing

1,637 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,095 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

623 Listeners

The Cloudcast by Massive Studios

The Cloudcast

153 Listeners

TED Tech by TED Tech

TED Tech

399 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

303 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

340 Listeners

DataFramed by DataCamp

DataFramed

268 Listeners

The Story by Mission

The Story

235 Listeners

Mission Daily by Mission.org

Mission Daily

220 Listeners

Practical AI by Practical AI LLC

Practical AI

214 Listeners

Inside the Strategy Room by McKinsey & Company

Inside the Strategy Room

169 Listeners

Education Trends by Mission

Education Trends

40 Listeners

The Future of Cities by Mission

The Future of Cities

75 Listeners

Marketing Trends by Mission

Marketing Trends

275 Listeners

AWS Podcast by Amazon Web Services

AWS Podcast

201 Listeners

The Journey by Mission.org

The Journey

59 Listeners

Find Your Mission by Mission

Find Your Mission

38 Listeners

Hidden In Plain Sight by Mission

Hidden In Plain Sight

87 Listeners

Up Next In Commerce by Mission

Up Next In Commerce

136 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

477 Listeners

Business X factors by Mission

Business X factors

23 Listeners

The Fleet by Mission

The Fleet

18 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

591 Listeners

HBR On Strategy by Harvard Business Review

HBR On Strategy

76 Listeners

Experts of Experience by Mission.org

Experts of Experience

20 Listeners

Life with Pets by Buddies by Blue Buffalo

Life with Pets

59 Listeners