From First Principles

FFP Story — Breakthrough Analog AI Computer Is 100× More Efficient Than GPUs (EP. 7)


Listen Later

Hosted by Lester Nare and Krishna Choudhary, this story dives into Microsoft’s analog optical AI computer — a breakthrough published in Nature that runs on light instead of transistors. The system cracks two fundamental AI bottlenecks, achieving 100× energy efficiency compared to GPUs. Beyond cutting costs and power demand for data centers, the same architecture could reduce MRI scans from an hour to just five minutes, showing how fundamental physics can transform both tech and healthcare.


Summary

• Microsoft unveils an analog optical AI computer, published in Nature

• Why Moore’s Law slowdown and the von Neumann bottleneck strain AI computing

• AI’s energy demand projected to hit 20% of global electricity by 2030

• Analog design uses LEDs, filters, and CCDs instead of GPUs

• Solves matrix multiplication and nonlinearities directly in hardware

• Delivers 100× energy efficiency over GPUs

• Works for inference, not training — but that’s most AI usage

• Bonus: excels at combinatorial optimization like MRI reconstruction

• Medical impact: MRI scans reduced from 30–60 minutes to ~5 minutes


Show Notes

  • Nature — Analog AI Research
  • Microsoft Research Blog
...more
View all episodesView all episodes
Download on the App Store

From First PrinciplesBy Krishna Choudhary and Lester Nare

  • 5
  • 5
  • 5
  • 5
  • 5

5

32 ratings


More shows like From First Principles

View all
Stuff You Should Know by iHeartPodcasts

Stuff You Should Know

78,732 Listeners

Radiolab by WNYC Studios

Radiolab

43,998 Listeners

Wait Wait... Don't Tell Me! by NPR

Wait Wait... Don't Tell Me!

38,885 Listeners

My Brother, My Brother And Me by The McElroys

My Brother, My Brother And Me

30,121 Listeners

Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,323 Listeners

Science Vs by Spotify Studios

Science Vs

12,084 Listeners

Science Friday by Science Friday and WNYC Studios

Science Friday

6,438 Listeners

What Trump Can Teach Us About Con Law by Roman Mars

What Trump Can Teach Us About Con Law

3,980 Listeners

Ologies with Alie Ward by Alie Ward

Ologies with Alie Ward

24,513 Listeners

Decoder Ring by Slate Podcasts

Decoder Ring

2,122 Listeners

Throughline by NPR

Throughline

16,379 Listeners

Short Wave by NPR

Short Wave

6,563 Listeners

Unexplainable by Vox

Unexplainable

2,309 Listeners

Serious Trouble by Josh Barro and Ken White

Serious Trouble

432 Listeners

Hasan Minhaj Doesn't Know by 186k Films

Hasan Minhaj Doesn't Know

470 Listeners