Eye On A.I.

#308 Christopher Bergey: How Arm Enables AI to Run Directly on Devices


Listen Later

Try OCI for free at http://oracle.com/eyeonai

This episode is sponsored by Oracle. OCI is the next-generation cloud designed for every workload – where you can run any application, including any AI projects, faster and more securely for less. On average, OCI costs 50% less for compute, 70% less for storage, and 80% less for networking.

Join Modal, Skydance Animation, and today's innovative AI tech companies who upgraded to OCI…and saved.

Why is AI moving from the cloud to our devices, and what makes on device intelligence finally practical at scale?

In this episode of Eye on AI, host Craig Smith speaks with Christopher Bergey, Executive Vice President of Arm's Edge AI Business Unit, about how edge AI is reshaping computing across smartphones, PCs, wearables, cars, and everyday devices.

We explore how Arm v9 enables AI inference at the edge, why heterogeneous computing across CPUs, GPUs, and NPUs matters, and how developers can balance performance, power, memory, and latency. Learn why memory bandwidth has become the biggest bottleneck for AI, how Arm approaches scalable matrix extensions, and what trade offs exist between accelerators and traditional CPU based AI workloads.

You will also hear real world examples of edge AI in action, from smart cameras and hearing aids to XR devices, robotics, and in car systems. The conversation looks ahead to a future where intelligence is embedded into everything you use, where AI becomes the default interface, and why reliable, low latency, on device AI is essential for creating experiences users actually trust.

Stay Updated: Craig Smith on X: https://x.com/craigss Eye on A.I. on X: https://x.com/EyeOn_AI

...more
View all episodesView all episodes
Download on the App Store

Eye On A.I.By Craig S. Smith

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

55 ratings


More shows like Eye On A.I.

View all
Data Skeptic by Kyle Polich

Data Skeptic

478 Listeners

The AI in Business Podcast by Daniel Faggella

The AI in Business Podcast

169 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

345 Listeners

AI Today Podcast by AI & Data Today

AI Today Podcast

158 Listeners

Practical AI by Daniel Whitenack and Chris Benson

Practical AI

208 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

99 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

143 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

101 Listeners

AI Chat: AI News & Artificial Intelligence by Jaeden Schafer

AI Chat: AI News & Artificial Intelligence

159 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

226 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

682 Listeners

AI For Humans: Weekly AI News, Tools & Trends by Kevin Pereira & Gavin Purcell

AI For Humans: Weekly AI News, Tools & Trends

278 Listeners

Practical News: AI & Business News by Practical News

Practical News: AI & Business News

25 Listeners

AI + a16z by a16z

AI + a16z

34 Listeners

Training Data by Sequoia Capital

Training Data

39 Listeners