TechFirst with John Koetsier

Fruit fly AI: SLMs are the new LLMs


Listen Later

AI is devouring the planet’s electricity ... already using up to 2% of global energy and projected to hit 5% by 2030. But a Spanish-Canadian company, Multiverse Computing, says it can slash that energy footprint by up to 95% without sacrificing performance.


They specialize in tiny AI: one model has the processing power of just 2 fruit fly brains. Another tiny model lives on a Raspberry Pi.


The opportunities for edge AI are huge. But the opportunities in the cloud are also massive.


In this episode of TechFirst, host John Koetsier talks with Samuel Mugel, Multiverse’s CEO, about how quantum-inspired algorithms can drastically compress large language models while keeping them smart, useful, and fast. Mugel explains how their approach -- intelligently pruning and reorganizing model weights -- lets them fit functioning AIs into hardware as tiny as a Raspberry Pi or the equivalent of a fly’s brain.


They explore how small language models could power Edge AI, smart appliances, and robots that work offline and in real time, while also making AI more sustainable, accessible, and affordable.


Mugel also discusses how ideas from quantum tensor networks help identify only the most relevant parts of a model, and how the company uses an “intelligently destructive” approach that saves massive compute and power.


00:00 – AI’s energy crisis

01:00 – A model in a fly’s brain

02:00 – Why tiny AIs work

03:00 – Edge AI everywhere

05:00 – Agent compute overload

06:00 – 200× too much compute

07:00 – The GPU crunch

08:00 – Smart matter vision

09:00 – AI on a Raspberry Pi

10:00 – How compression works

11:00 – Intelligent destruction

13:00 – General vs. narrow AIs

15:00 – Quantum inspiration

17:00 – Quantum + AI future

18:00 – AI’s carbon footprint

19:00 – Cost of using AI

20:00 – Cloud to edge shift

21:00 – Robots need fast AI

22:00 – Wrapping up

...more
View all episodesView all episodes
Download on the App Store

TechFirst with John KoetsierBy John Koetsier

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

14 ratings


More shows like TechFirst with John Koetsier

View all
Radiolab by WNYC Studios

Radiolab

43,883 Listeners

Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,051 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,094 Listeners

Universe Today Podcast by Fraser Cain

Universe Today Podcast

561 Listeners

The Quanta Podcast by Quanta Magazine

The Quanta Podcast

531 Listeners

Pod Save America by Crooked Media

Pod Save America

87,797 Listeners

The Daily by The New York Times

The Daily

112,765 Listeners

GZERO World with Ian Bremmer by GZERO Media

GZERO World with Ian Bremmer

808 Listeners

Cautionary Tales with Tim Harford by Pushkin Industries

Cautionary Tales with Tim Harford

5,151 Listeners

All Things Photonics by All Things Photonics

All Things Photonics

12 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,888 Listeners

Hard Fork by The New York Times

Hard Fork

5,506 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,068 Listeners

Open Circuit by Latitude Media

Open Circuit

139 Listeners

Sourcery by Sourcery with Molly O'Shea

Sourcery

2 Listeners