Sign up to save your podcasts
Or
Share “Actually, Power Plants May Be an AI Training Bottleneck.” by Lao Mein
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
“Actually, Power Plants May Be an AI Training Bottleneck.” by Lao Mein
There have been presistent rumors that electricity generation was somehow bottlenecking new data centers. This claim was recently repeated by Donald Trump, who implied that San Francisco donors requested the construction of new power plants for powering new AI data centers in the US. While this may sound unlikely, my research suggests it's actually quite plausible.
Electricity generation, capacity, and sales in the United States - U.S. Energy Information Administration (EIA)Electricity generation, capacity, and sales in the United States - U.S. Energy Information Administration (EIA)US electricity production has been stagnant since 2007. Current electricity generation is ~ 500 million kW. An H100 consumes 700 W at peak capacity. Sales of H100s were ~500,000 in 2023 and expected to climb to 1.5-2 million in 2024. "Servers" account for only 40% of data center power consumption, and that includes non-GPU overhead. I'll assume a total of 2 kW per H100 for [...]
---
First published:
June 20th, 2024
Source:
https://www.lesswrong.com/posts/DsoqEcnCu8vQeeeBe/actually-power-plants-may-be-an-ai-training-bottleneck
---
Narrated by TYPE III AUDIO.
View all episodes
By LessWrongThere have been presistent rumors that electricity generation was somehow bottlenecking new data centers. This claim was recently repeated by Donald Trump, who implied that San Francisco donors requested the construction of new power plants for powering new AI data centers in the US. While this may sound unlikely, my research suggests it's actually quite plausible.
Electricity generation, capacity, and sales in the United States - U.S. Energy Information Administration (EIA)Electricity generation, capacity, and sales in the United States - U.S. Energy Information Administration (EIA)US electricity production has been stagnant since 2007. Current electricity generation is ~ 500 million kW. An H100 consumes 700 W at peak capacity. Sales of H100s were ~500,000 in 2023 and expected to climb to 1.5-2 million in 2024. "Servers" account for only 40% of data center power consumption, and that includes non-GPU overhead. I'll assume a total of 2 kW per H100 for [...]
---
First published:
June 20th, 2024
Source:
https://www.lesswrong.com/posts/DsoqEcnCu8vQeeeBe/actually-power-plants-may-be-an-ai-training-bottleneck
---
Narrated by TYPE III AUDIO.
More shows like LessWrong (30+ Karma)
View all
The Daily
113,026 Listeners
Astral Codex Ten Podcast
132 Listeners
Interesting Times with Ross Douthat
7,266 Listeners
Dwarkesh Podcast
560 Listeners
The Ezra Klein Show
16,495 Listeners
AI Article Readings
4 Listeners
Doom Debates!
14 Listeners
LessWrong posts by zvi
2 Listeners