80,000 Hours Podcast

#193 – Sihao Huang on the risk that US–China AI competition leads to war


Listen Later

"You don’t necessarily need world-leading compute to create highly risky AI systems. The biggest biological design tools right now, like AlphaFold’s, are orders of magnitude smaller in terms of compute requirements than the frontier large language models. And China has the compute to train these systems. And if you’re, for instance, building a cyber agent or something that conducts cyberattacks, perhaps you also don’t need the general reasoning or mathematical ability of a large language model. You train on a much smaller subset of data. You fine-tune it on a smaller subset of data. And those systems — one, if China intentionally misuses them, and two, if they get proliferated because China just releases them as open source, or China does not have as comprehensive AI regulations — this could cause a lot of harm in the world." —Sihao Huang

In today’s episode, host Luisa Rodriguez speaks to Sihao Huang about his work on AI governance and tech policy in China, what’s happening on the ground in China in AI development and regulation, and the importance of US–China cooperation on AI governance.

Links to learn more, highlights, video, and full transcript.

They cover:

  • Whether the US and China are in an AI race, and the global implications if they are.
  • The state of the art of AI in China.
  • China’s response to American export controls, and whether China is on track to indigenise its semiconductor supply chain.
  • How China’s current AI regulations try to maintain a delicate balance between fostering innovation and keeping strict information control over the Chinese people.
  • Whether China’s extensive AI regulations signal real commitment to safety or just censorship — and how AI is already used in China for surveillance and authoritarian control.
  • How advancements in AI could reshape global power dynamics, and Sihao’s vision of international cooperation to manage this responsibly.
  • And plenty more.

Chapters:

  • Cold open (00:00:00)
  • Luisa's intro (00:01:02)
  • The interview begins (00:02:06)
  • Is China in an AI race with the West? (00:03:20)
  • How advanced is Chinese AI? (00:15:21)
  • Bottlenecks in Chinese AI development (00:22:30)
  • China and AI risks (00:27:41)
  • Information control and censorship (00:31:32)
  • AI safety research in China (00:36:31)
  • Could China be a source of catastrophic AI risk? (00:41:58)
  • AI enabling human rights abuses and undermining democracy (00:50:10)
  • China’s semiconductor industry (00:59:47)
  • China’s domestic AI governance landscape (01:29:22)
  • China’s international AI governance strategy (01:49:56)
  • Coordination (01:53:56)
  • Track two dialogues (02:03:04)
  • Misunderstandings Western actors have about Chinese approaches (02:07:34)
  • Complexity thinking (02:14:40)
  • Sihao’s pet bacteria hobby (02:20:34)
  • Luisa's outro (02:22:47)


Producer and editor: Keiran Harris
Audio engineering team: Ben Cordell, Simon Monsour, Milo McGuire, and Dominic Armstrong
Additional content editing: Katy Moore and Luisa Rodriguez
Transcriptions: Katy Moore

...more
View all episodesView all episodes
Download on the App Store

80,000 Hours PodcastBy Rob, Luisa, and the 80,000 Hours team

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

280 ratings


More shows like 80,000 Hours Podcast

View all
EconTalk by Russ Roberts

EconTalk

4,221 Listeners

Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,286 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,361 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

439 Listeners

The Joe Walker Podcast by Joe Walker

The Joe Walker Podcast

122 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

92 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

320 Listeners

Clearer Thinking with Spencer Greenberg by Spencer Greenberg

Clearer Thinking with Spencer Greenberg

131 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

106 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

70 Listeners

"Upstream" with Erik Torenberg by Erik Torenberg

"Upstream" with Erik Torenberg

68 Listeners

"Econ 102" with Noah Smith and Erik Torenberg by Turpentine

"Econ 102" with Noah Smith and Erik Torenberg

136 Listeners

The Studies Show by Tom Chivers and Stuart Ritchie

The Studies Show

62 Listeners

Complex Systems with Patrick McKenzie (patio11) by Patrick McKenzie

Complex Systems with Patrick McKenzie (patio11)

103 Listeners

The Marginal Revolution Podcast by Mercatus Center at George Mason University

The Marginal Revolution Podcast

90 Listeners