Sign up to save your podcasts
Or
Share “Actually, Power Plants May Be an AI Training Bottleneck.” by Lao Mein
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
“Actually, Power Plants May Be an AI Training Bottleneck.” by Lao Mein
There have been presistent rumors that electricity generation was somehow bottlenecking new data centers. This claim was recently repeated by Donald Trump, who implied that San Francisco donors requested the construction of new power plants for powering new AI data centers in the US. While this may sound unlikely, my research suggests it's actually quite plausible.
Electricity generation, capacity, and sales in the United States - U.S. Energy Information Administration (EIA)Electricity generation, capacity, and sales in the United States - U.S. Energy Information Administration (EIA)US electricity production has been stagnant since 2007. Current electricity generation is ~ 500 million kW. An H100 consumes 700 W at peak capacity. Sales of H100s were ~500,000 in 2023 and expected to climb to 1.5-2 million in 2024. "Servers" account for only 40% of data center power consumption, and that includes non-GPU overhead. I'll assume a total of 2 kW per H100 for [...]
---
First published:
June 20th, 2024
Source:
https://www.lesswrong.com/posts/DsoqEcnCu8vQeeeBe/actually-power-plants-may-be-an-ai-training-bottleneck
---
Narrated by TYPE III AUDIO.
View all episodes
By LessWrongThere have been presistent rumors that electricity generation was somehow bottlenecking new data centers. This claim was recently repeated by Donald Trump, who implied that San Francisco donors requested the construction of new power plants for powering new AI data centers in the US. While this may sound unlikely, my research suggests it's actually quite plausible.
Electricity generation, capacity, and sales in the United States - U.S. Energy Information Administration (EIA)Electricity generation, capacity, and sales in the United States - U.S. Energy Information Administration (EIA)US electricity production has been stagnant since 2007. Current electricity generation is ~ 500 million kW. An H100 consumes 700 W at peak capacity. Sales of H100s were ~500,000 in 2023 and expected to climb to 1.5-2 million in 2024. "Servers" account for only 40% of data center power consumption, and that includes non-GPU overhead. I'll assume a total of 2 kW per H100 for [...]
---
First published:
June 20th, 2024
Source:
https://www.lesswrong.com/posts/DsoqEcnCu8vQeeeBe/actually-power-plants-may-be-an-ai-training-bottleneck
---
Narrated by TYPE III AUDIO.
More shows like LessWrong (30+ Karma)
View all
Making Sense with Sam Harris
26,434 Listeners
Conversations with Tyler
2,388 Listeners
The Peter Attia Drive
7,906 Listeners
Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas
4,133 Listeners
ManifoldOne
87 Listeners
Your Undivided Attention
1,462 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
9,095 Listeners
Machine Learning Street Talk (MLST)
87 Listeners
Dwarkesh Podcast
389 Listeners
Hard Fork
5,429 Listeners
The Ezra Klein Show
15,174 Listeners
Moonshots with Peter Diamandis
474 Listeners
No Priors: Artificial Intelligence | Technology | Startups
121 Listeners
Latent Space: The AI Engineer Podcast
75 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
459 Listeners