
Sign up to save your podcasts
Or


GPUs are rare and expensive right now. Every company doing AI model training needs more, and NVIDIA can't build enough, especially of the NVIDIA H100 GPU.
Run.ai CEO and co-founder Omri Geller says he has a software solution to this hardware problem.
The key: GPUs are mostly idle, even in high-demand settings. According to Geller, his software 2X to 4Xs your GPU capacity on existing hardware, simply by streamlining workloads and maximizing GPU usage time.
In this TechFirst, we chat about:
- the GPU shortage
- how many GPUs we need
- what Open AI is using right now
- whether OpenAI is getting dumber or not
- and much more
As always, get a full transcript and subscribe to the audio podcast at my website:
https://johnkoetsier.com/category/tech-first/
By John Koetsier4.7
1414 ratings
GPUs are rare and expensive right now. Every company doing AI model training needs more, and NVIDIA can't build enough, especially of the NVIDIA H100 GPU.
Run.ai CEO and co-founder Omri Geller says he has a software solution to this hardware problem.
The key: GPUs are mostly idle, even in high-demand settings. According to Geller, his software 2X to 4Xs your GPU capacity on existing hardware, simply by streamlining workloads and maximizing GPU usage time.
In this TechFirst, we chat about:
- the GPU shortage
- how many GPUs we need
- what Open AI is using right now
- whether OpenAI is getting dumber or not
- and much more
As always, get a full transcript and subscribe to the audio podcast at my website:
https://johnkoetsier.com/category/tech-first/

43,967 Listeners

32,097 Listeners

1,098 Listeners

570 Listeners

546 Listeners

87,566 Listeners

112,234 Listeners

807 Listeners

5,105 Listeners

12 Listeners

10,189 Listeners

5,544 Listeners

16,230 Listeners

140 Listeners

11 Listeners