TechFirst with John Koetsier

Solving the GPU shortage: software to 2-4X existing GPU utilization


Listen Later

GPUs are rare and expensive right now. Every company doing AI model training needs more, and NVIDIA can't build enough, especially of the NVIDIA H100 GPU.


Run.ai CEO and co-founder Omri Geller says he has a software solution to this hardware problem.


The key: GPUs are mostly idle, even in high-demand settings. According to Geller, his software 2X to 4Xs your GPU capacity on existing hardware, simply by streamlining workloads and maximizing GPU usage time.


In this TechFirst, we chat about:

- the GPU shortage

- how many GPUs we need

- what Open AI is using right now

- whether OpenAI is getting dumber or not

- and much more


As always, get a full transcript and subscribe to the audio podcast at my website:

https://johnkoetsier.com/category/tech-first/

...more
View all episodesView all episodes
Download on the App Store

TechFirst with John KoetsierBy John Koetsier

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

14 ratings


More shows like TechFirst with John Koetsier

View all
Odd Lots by Bloomberg

Odd Lots

1,773 Listeners

Pardon My Take by Barstool Sports

Pardon My Take

81,783 Listeners

The Daily by The New York Times

The Daily

111,438 Listeners

Up First from NPR by NPR

Up First from NPR

56,016 Listeners

ChinaTalk by Jordan Schneider

ChinaTalk

270 Listeners

Google DeepMind: The Podcast by Hannah Fry

Google DeepMind: The Podcast

198 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,045 Listeners

GoodFellows: Conversations from the Hoover Institution by Hoover Institution

GoodFellows: Conversations from the Hoover Institution

677 Listeners

Hard Fork by The New York Times

Hard Fork

5,426 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

15,207 Listeners

WSJ Opinion: Free Expression by Gerard Baker, Editor at Large, The Wall Street Journal

WSJ Opinion: Free Expression

577 Listeners

王志安的播客Wang’s Podcast by 王志安

王志安的播客Wang’s Podcast

476 Listeners

Leading Indicator by Public.com

Leading Indicator

6 Listeners

Betting on America: Winning the Global Tech Race by Center for Strategic and International Studies

Betting on America: Winning the Global Tech Race

1 Listeners