From First Principles

FFP Story — Breakthrough Analog AI Computer Is 100× More Efficient Than GPUs (EP. 7)


Listen Later

Hosted by Lester Nare and Krishna Choudhary, this story dives into Microsoft’s analog optical AI computer — a breakthrough published in Nature that runs on light instead of transistors. The system cracks two fundamental AI bottlenecks, achieving 100× energy efficiency compared to GPUs. Beyond cutting costs and power demand for data centers, the same architecture could reduce MRI scans from an hour to just five minutes, showing how fundamental physics can transform both tech and healthcare.


Summary

• Microsoft unveils an analog optical AI computer, published in Nature

• Why Moore’s Law slowdown and the von Neumann bottleneck strain AI computing

• AI’s energy demand projected to hit 20% of global electricity by 2030

• Analog design uses LEDs, filters, and CCDs instead of GPUs

• Solves matrix multiplication and nonlinearities directly in hardware

• Delivers 100× energy efficiency over GPUs

• Works for inference, not training — but that’s most AI usage

• Bonus: excels at combinatorial optimization like MRI reconstruction

• Medical impact: MRI scans reduced from 30–60 minutes to ~5 minutes


Show Notes

  • Nature — Analog AI Research
  • Microsoft Research Blog
...more
View all episodesView all episodes
Download on the App Store

From First PrinciplesBy Krishna Choudhary and Lester Nare

  • 4.9
  • 4.9
  • 4.9
  • 4.9
  • 4.9

4.9

74 ratings


More shows like From First Principles

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,087 Listeners

Planet Money by NPR

Planet Money

30,693 Listeners

StarTalk Radio by Neil deGrasse Tyson

StarTalk Radio

14,390 Listeners

Planetary Radio: Space Exploration, Astronomy and Science by The Planetary Society

Planetary Radio: Space Exploration, Astronomy and Science

1,346 Listeners

The Quanta Podcast by Quanta Magazine

The Quanta Podcast

549 Listeners

Into the Impossible With Brian Keating by Big Bang Productions Inc.

Into the Impossible With Brian Keating

1,071 Listeners

The Michael Shermer Show by Michael Shermer

The Michael Shermer Show

934 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,170 Listeners

Within Reason by Alex J O'Connor

Within Reason

1,652 Listeners

The Prof G Pod with Scott Galloway by Vox Media Podcast Network

The Prof G Pod with Scott Galloway

5,495 Listeners

Doomscroll with Joshua Citarella by Joshua Citarella

Doomscroll with Joshua Citarella

284 Listeners

Hard Fork by The New York Times

Hard Fork

5,535 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,139 Listeners

The Weekly Show with Jon Stewart by Comedy Central

The Weekly Show with Jon Stewart

10,752 Listeners

Prof G Markets by Vox Media Podcast Network

Prof G Markets

1,487 Listeners