Eye On A.I.

#275 Nandan Nayampally: How Baya Systems is Fixing the Biggest Bottleneck in AI Chips (Data Flow)


Listen Later

What if the biggest challenge in AI isn't how fast chips can compute, but how quickly data can move? In this episode of Eye on AI, Nandan Nayampally, Chief Commercial Officer at Baya Systems, shares how the next era of computing is being shaped by smarter architecture, not just raw processing power. With experience leading teams at ARM, Amazon Alexa, and BrainChip, Nandan brings a rare perspective on how modern chip design is evolving. We dive into the world of chiplets, network-on-chip (NoC) technology, silicon photonics, and neuromorphic computing. Nandan explains why the traditional path of scaling transistors is no longer enough, and how Baya Systems is solving the real bottlenecks in AI hardware through efficient data movement and modular design. From punch cards to AGI, this conversation maps the full arc of computing innovation. If you want to understand how to build hardware for the future of AI, this episode is a must-listen. Subscribe to Eye on AI for more conversations on the future of artificial intelligence and system design. Stay Updated: Craig Smith on X:https://x.com/craigss Eye on A.I. on X: https://x.com/EyeOn_AI (00:00) Why AI's Bottleneck Is Data Movement (01:26) Nandan's Background and Semiconductor Career (03:06) What Baya Systems Does: Network-on-Chip + Software (08:40) A Brief History of Computing: From Punch Cards to AGI (11:47) Silicon Photonics and the Evolution of Data Transfer (20:04) How Baya Is Solving Real AI Hardware Challenges (22:13) Understanding CPUs, GPUs, and NPUs in AI Workloads (24:09) Building Efficient Chips: Cost, Speed, and Customization (27:17) Performance, Power, and Area (PPA) in Chip Design (30:55) Partnering to Build Next-Gen Photonic and Copper Systems (32:29) Why Moore's Law Has Slowed and What Comes Next (34:49) Wafer-Scale vs Traditional Die: Where Baya Fits In (36:10) Chiplet Stacking and Composability Explained (39:44) The Future of On-Chip Networking (41:10) Neuromorphic Computing: Energy-Efficient AI (43:02) Edge AI, Small Models, and Structured State Spaces

...more
View all episodesView all episodes
Download on the App Store

Eye On A.I.By Craig S. Smith

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

55 ratings


More shows like Eye On A.I.

View all
Data Skeptic by Kyle Polich

Data Skeptic

478 Listeners

The AI in Business Podcast by Daniel Faggella

The AI in Business Podcast

172 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

341 Listeners

AI Today Podcast by AI & Data Today

AI Today Podcast

155 Listeners

Practical AI by Practical AI LLC

Practical AI

213 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

90 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

133 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

95 Listeners

AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

AI Chat: ChatGPT, AI News, Artificial Intelligence, OpenAI, Machine Learning

155 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

209 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

589 Listeners

AI For Humans: Making Artificial Intelligence Fun & Practical by Kevin Pereira & Gavin Purcell

AI For Humans: Making Artificial Intelligence Fun & Practical

269 Listeners

Practical: AI & Business News by Practical News

Practical: AI & Business News

26 Listeners

AI + a16z by a16z

AI + a16z

35 Listeners

Training Data by Sequoia Capital

Training Data

37 Listeners