Industrial IoT Spotlight

EP 226 - Neuromorphic for LLMs on the Edge


Listen Later

In this episode, we spoke with Sean Hehir, CEO, and Jonathan Tapson, Chief Development Officer, of BrainChip about neuromorphic computing for edge AI. We covered why event-based processing and sparsity let devices skip 99% of useless sensor data, why joules per inference is a more honest metric than TOPS, how PPA (power, performance, area) guides on-device design, and what it will take to run a compact billion-parameter LLM entirely on device.

We also discussed practical use cases like seizure-prediction eyewear, drones for beach safety, and efficiency upgrades in vehicles, plus BrainChip's adoption path via MetaTF and its IP-licensing business model.

Key insights:

• Neuromorphic efficiency. Event-based compute minimizes data transfer and optimizes for joules per inference, enabling low-power, real-time applications in medical, defense, industrial IoT, and automotive.

• LLMs at the edge. Compact silicon and state-based designs are pushing billion-parameter models onto devices, achieving useful performance at much lower power.

• Adoption is designed to be straightforward. Models built in standard frameworks can be mapped to BrainChip's Akida platform using MetaTF, with PPA guiding silicon optimization and early evaluation possible through simulation and dev kits.

• Compelling use cases. Examples include seizure-prediction smart glasses aiming for all-day battery life in a tiny form factor and drones scanning beaches for distressed swimmers. Most current engagements are pure on-edge, with hybrid edge-plus-cloud possible when appropriate.

IoT ONE database: https://www.iotone.com/case-studies

The Industrial IoT Spotlight podcast is produced by Asia Growth Partners (AGP): https://asiagrowthpartners.com/

...more
View all episodesView all episodes
Download on the App Store

Industrial IoT SpotlightBy Peter Rohde-Chen, Erik Walenza

  • 4.5
  • 4.5
  • 4.5
  • 4.5
  • 4.5

4.5

30 ratings


More shows like Industrial IoT Spotlight

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,081 Listeners

Motley Fool Money by The Motley Fool

Motley Fool Money

3,223 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,098 Listeners

Azeem Azhar's Exponential View by Azeem Azhar

Azeem Azhar's Exponential View

609 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

339 Listeners

The Daily by The New York Times

The Daily

112,942 Listeners

The Diary Of A CEO with Steven Bartlett by DOAC

The Diary Of A CEO with Steven Bartlett

8,991 Listeners

Servus. Grüezi. Hallo. by DIE ZEIT

Servus. Grüezi. Hallo.

56 Listeners

Worklife with Adam Grant by TED

Worklife with Adam Grant

9,157 Listeners

Wall Street Breakfast by Seeking Alpha

Wall Street Breakfast

1,039 Listeners

Easy German: Learn German with native speakers | Deutsch lernen mit Muttersprachlern by Cari, Manuel und das Team von Easy German

Easy German: Learn German with native speakers | Deutsch lernen mit Muttersprachlern

959 Listeners

Hard Fork by The New York Times

Hard Fork

5,481 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,098 Listeners

The Mel Robbins Podcast by Mel Robbins

The Mel Robbins Podcast

20,208 Listeners