Industrial IoT Spotlight

EP 226 - Neuromorphic for LLMs on the Edge


Listen Later

In this episode, we spoke with Sean Hehir, CEO, and Jonathan Tapson, Chief Development Officer, of BrainChip about neuromorphic computing for edge AI. We covered why event-based processing and sparsity let devices skip 99% of useless sensor data, why joules per inference is a more honest metric than TOPS, how PPA (power, performance, area) guides on-device design, and what it will take to run a compact billion-parameter LLM entirely on device.

We also discussed practical use cases like seizure-prediction eyewear, drones for beach safety, and efficiency upgrades in vehicles, plus BrainChip's adoption path via MetaTF and its IP-licensing business model.

Key insights:

• Neuromorphic efficiency. Event-based compute minimizes data transfer and optimizes for joules per inference, enabling low-power, real-time applications in medical, defense, industrial IoT, and automotive.

• LLMs at the edge. Compact silicon and state-based designs are pushing billion-parameter models onto devices, achieving useful performance at much lower power.

• Adoption is designed to be straightforward. Models built in standard frameworks can be mapped to BrainChip's Akida platform using MetaTF, with PPA guiding silicon optimization and early evaluation possible through simulation and dev kits.

• Compelling use cases. Examples include seizure-prediction smart glasses aiming for all-day battery life in a tiny form factor and drones scanning beaches for distressed swimmers. Most current engagements are pure on-edge, with hybrid edge-plus-cloud possible when appropriate.

IoT ONE database: https://www.iotone.com/case-studies

The Industrial IoT Spotlight podcast is produced by Asia Growth Partners (AGP): https://asiagrowthpartners.com/

...more
View all episodesView all episodes
Download on the App Store

Industrial IoT SpotlightBy Peter Rohde-Chen, Erik Walenza

  • 4.5
  • 4.5
  • 4.5
  • 4.5
  • 4.5

4.5

30 ratings


More shows like Industrial IoT Spotlight

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,039 Listeners

Motley Fool Money by The Motley Fool

Motley Fool Money

3,221 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,082 Listeners

Azeem Azhar's Exponential View by Azeem Azhar

Azeem Azhar's Exponential View

612 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

333 Listeners

The Daily by The New York Times

The Daily

112,572 Listeners

The Diary Of A CEO with Steven Bartlett by DOAC

The Diary Of A CEO with Steven Bartlett

8,547 Listeners

Servus. Grüezi. Hallo. by DIE ZEIT

Servus. Grüezi. Hallo.

57 Listeners

Worklife with Adam Grant by TED

Worklife with Adam Grant

9,154 Listeners

Wall Street Breakfast by Seeking Alpha

Wall Street Breakfast

1,040 Listeners

Easy German: Learn German with native speakers | Deutsch lernen mit Muttersprachlern by Cari, Manuel und das Team von Easy German

Easy German: Learn German with native speakers | Deutsch lernen mit Muttersprachlern

944 Listeners

Hard Fork by The New York Times

Hard Fork

5,530 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

15,995 Listeners

The Mel Robbins Podcast by Mel Robbins

The Mel Robbins Podcast

19,818 Listeners