Tech Talks Daily

3178: Is AI Infrastructure Broken? How DIaaS is Changing the Game


Listen Later

AI is everywhere, yet scaling it remains a serious challenge for many enterprises. Organizations are eager to move beyond pilot projects, but they quickly run into obstacles—cloud costs spiral out of control, GPUs sit idle due to inefficiencies, and infrastructure bottlenecks slow down innovation. If AI is supposed to be the future, why is the underlying infrastructure still holding it back?

In this episode, I'm joined by John Blumenthal, Chief Product Officer at Volumez, and Diane Gonzalez, Senior Director of Business Development and Product, to unpack the hidden inefficiencies of AI infrastructure and explore whether Data Infrastructure as a Service (DIaaS) is the answer. They explain why traditional AI infrastructure models are failing and why manual optimization simply can't keep up with modern AI workloads.

John argues that the problem is beyond human management, stating, "No human being is going to be able to answer that question—to actually arrive at that optimization. So you have to turn it over to a machine." We explore why cloud spending is so difficult to control, how businesses are struggling to achieve a return on their AI investments, and what it will take to make AI infrastructure more cost-effective and scalable.

Diane shares real-world examples of how AI teams are losing valuable time and resources trying to work around infrastructure constraints. She explains how DIaaS dynamically composes infrastructure on demand, eliminating bottlenecks and ensuring businesses can run AI workloads at full speed without overspending.

With AI adoption accelerating, organizations are rethinking their approach to cloud infrastructure. But is DIaaS the missing piece that will finally make AI truly scalable? And are businesses ready to let automation take the lead in optimizing their cloud environments? Join the conversation and share your thoughts.

...more
View all episodesView all episodes
Download on the App Store

Tech Talks DailyBy Neil C. Hughes

  • 5
  • 5
  • 5
  • 5
  • 5

5

198 ratings


More shows like Tech Talks Daily

View all
This Week in Startups by Jason Calacanis

This Week in Startups

1,285 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

533 Listeners

WSJ Tech News Briefing by The Wall Street Journal

WSJ Tech News Briefing

1,639 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,090 Listeners

HBR IdeaCast by Harvard Business Review

HBR IdeaCast

164 Listeners

Gartner ThinkCast by Gartner

Gartner ThinkCast

111 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

303 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

334 Listeners

DataFramed by DataCamp

DataFramed

269 Listeners

Practical AI by Practical AI LLC

Practical AI

207 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,938 Listeners

Hard Fork by The New York Times

Hard Fork

5,509 Listeners

Business Breakdowns by Colossus | Investing & Business Podcasts

Business Breakdowns

349 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

93 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

611 Listeners

Consulting the Future by Neil C. Hughes

Consulting the Future

0 Listeners

Startup Builders & Backers by Neil C. Hughes

Startup Builders & Backers

0 Listeners

IT Infrastructure as a Conversation by Neil C. Hughes

IT Infrastructure as a Conversation

0 Listeners

AI at Work by Neil C. Hughes

AI at Work

0 Listeners

The Business of Cybersecurity by Neil C. Hughes

The Business of Cybersecurity

0 Listeners

Business Technology Perspectives by Neil Hughes

Business Technology Perspectives

0 Listeners

Conversations from the Show Floor by Neil C. Hughes

Conversations from the Show Floor

0 Listeners