TechFirst with John Koetsier

Solving the GPU shortage: software to 2-4X existing GPU utilization


Listen Later

GPUs are rare and expensive right now. Every company doing AI model training needs more, and NVIDIA can't build enough, especially of the NVIDIA H100 GPU.


Run.ai CEO and co-founder Omri Geller says he has a software solution to this hardware problem.


The key: GPUs are mostly idle, even in high-demand settings. According to Geller, his software 2X to 4Xs your GPU capacity on existing hardware, simply by streamlining workloads and maximizing GPU usage time.


In this TechFirst, we chat about:

- the GPU shortage

- how many GPUs we need

- what Open AI is using right now

- whether OpenAI is getting dumber or not

- and much more


As always, get a full transcript and subscribe to the audio podcast at my website:

https://johnkoetsier.com/category/tech-first/

...more
View all episodesView all episodes
Download on the App Store

TechFirst with John KoetsierBy John Koetsier

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

14 ratings


More shows like TechFirst with John Koetsier

View all
Radiolab by WNYC Studios

Radiolab

43,870 Listeners

Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

31,989 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,093 Listeners

Universe Today Podcast by Fraser Cain

Universe Today Podcast

560 Listeners

The Quanta Podcast by Quanta Magazine

The Quanta Podcast

531 Listeners

Pod Save America by Crooked Media

Pod Save America

87,146 Listeners

The Daily by The New York Times

The Daily

112,032 Listeners

GZERO World with Ian Bremmer by GZERO Media

GZERO World with Ian Bremmer

799 Listeners

Cautionary Tales with Tim Harford by Pushkin Industries

Cautionary Tales with Tim Harford

5,151 Listeners

All Things Photonics by All Things Photonics

All Things Photonics

12 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,955 Listeners

Hard Fork by The New York Times

Hard Fork

5,506 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

15,832 Listeners

Open Circuit by Latitude Media

Open Circuit

140 Listeners

Sourcery by Sourcery with Molly O'Shea

Sourcery

4 Listeners