Sign up to save your podcasts
Or
Share What if Humans Weaponize Superintelligence, w/ Tom Davidson, from Future of Life Institute Podcast
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
What if Humans Weaponize Superintelligence, w/ Tom Davidson, from Future of Life Institute Podcast
Today Tom Davidson of Forethought joins Gus Docker of the Future of Life Institute podcast to discuss AI-enabled coups and how future AI systems could help powerful individuals seize political control, exploring three threat models—singular loyalties, secret loyalties, and exclusive access—along with their estimated 10% likelihood over the next 30 years and potential mitigation strategies.
Check out our sponsors: Oracle Cloud Infrastructure, Shopify.
Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at https://notion.com/lp/nathan
Three Primary AI Coup Enablement Methods: Tom Davidson identifies singular loyalties, secret loyalties, and distributed control as the main ways AI could enable coups.
Singular Loyalties Risk: AI systems explicitly programmed to be loyal to specific individuals present a significant threat, especially when AI can fully replace humans in critical roles.
Secret Loyalties Threat: AI systems with hidden backdoors or "sleeper agents" that can be activated to serve particular interests represent a subtle but dangerous coup vector.
Geopolitical Implications: Advanced AI capabilities could enable nations to instigate coups in other countries through secretly loyal systems or by providing exclusive AI access to specific politicians.
Adversarial Testing Framework: An effective approach involves red teams attempting to produce secret loyalties while blue teams try to detect them, revealing vulnerable points in AI systems.
Military Procurement Principles: Developing consensus within military communities around principles like law-following and distributed control could create safer AI procurement processes.
Sponsors:
Oracle Cloud Infrastructure:
Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive
Shopify:
Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive
PRODUCED BY:
https://aipodcast.ing
View all episodes
By Erik Torenberg, Nathan Labenz
4.5
9090 ratings
Today Tom Davidson of Forethought joins Gus Docker of the Future of Life Institute podcast to discuss AI-enabled coups and how future AI systems could help powerful individuals seize political control, exploring three threat models—singular loyalties, secret loyalties, and exclusive access—along with their estimated 10% likelihood over the next 30 years and potential mitigation strategies.
Check out our sponsors: Oracle Cloud Infrastructure, Shopify.
Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at https://notion.com/lp/nathan
Three Primary AI Coup Enablement Methods: Tom Davidson identifies singular loyalties, secret loyalties, and distributed control as the main ways AI could enable coups.
Singular Loyalties Risk: AI systems explicitly programmed to be loyal to specific individuals present a significant threat, especially when AI can fully replace humans in critical roles.
Secret Loyalties Threat: AI systems with hidden backdoors or "sleeper agents" that can be activated to serve particular interests represent a subtle but dangerous coup vector.
Geopolitical Implications: Advanced AI capabilities could enable nations to instigate coups in other countries through secretly loyal systems or by providing exclusive AI access to specific politicians.
Adversarial Testing Framework: An effective approach involves red teams attempting to produce secret loyalties while blue teams try to detect them, revealing vulnerable points in AI systems.
Military Procurement Principles: Developing consensus within military communities around principles like law-following and distributed control could create safer AI procurement processes.
Sponsors:
Oracle Cloud Infrastructure:
Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive
Shopify:
Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive
PRODUCED BY:
https://aipodcast.ing
More shows like "The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
View all
The a16z Show
1,089 Listeners
Super Data Science: ML & AI Podcast with Jon Krohn
302 Listeners
Y Combinator Startup Podcast
226 Listeners
Practical AI
211 Listeners
Machine Learning Street Talk (MLST)
95 Listeners
Dwarkesh Podcast
511 Listeners
No Priors: Artificial Intelligence | Technology | Startups
131 Listeners
This Day in AI Podcast
227 Listeners
The AI Daily Brief: Artificial Intelligence News and Analysis
610 Listeners
The MAD Podcast with Matt Turck
27 Listeners
AI and I
33 Listeners
AI + a16z
35 Listeners
Lightcone Podcast
21 Listeners
Training Data
40 Listeners
Uncapped with Jack Altman
44 Listeners