London Futurists

Governing the transition to AGI, with Jerome Glenn


Listen Later

Our guest on this episode is someone with excellent connections to the foresight departments of governments around the world. He is Jerome Glenn, Founder and Executive Director of the Millennium Project.

The Millennium Project is a global participatory think tank established in 1996, which now has over 70 nodes around the world. It has the stated purpose to "Improve humanity's prospects for building a better world". The organisation produces regular "State of the Future" reports as well as updates on what it describes as "the 15 Global Challenges". It recently released an acclaimed report on three scenarios for the future of work. One of its new projects is the main topic in this episode, namely scenarios for the global governance of the transition from Artificial Narrow Intelligence (ANI) to Artificial General Intelligence (AGI).

Topics discussed in this episode include:
*) Why many futurists are jealous of Alvin Toffler
*) The benefits of a decentralised, incremental approach to foresight studies
*) Special features of the Millennium Project compared to other think tanks
*) How the Information Revolution differs from the Industrial Revolution
*) What is likely to happen if there is no governance of the transition to AGI
*) Comparisons with regulating the use of cars - and the use of nuclear materials
*) Options for licensing, auditing, and monitoring
*) How the development of a technology may be governed even if it has few visible signs
*) Three options: "Hope", "Control", and "Merge" - but all face problems; in all three cases, getting the initial conditions right could make a huge difference
*) Distinctions between AGI and ASI (Artificial Superintelligence), and whether an ASI could act in defiance of its initial conditions
*) Controlling AGI is likely to be impossible, but controlling the companies that are creating AGI is more credible
*) How actions taken by the EU might influence decisions elsewhere in the world
*) Options for "aligning" AGI as opposed to "controlling" it
*) Complications with the use of advanced AI by organised crime and by rogue states
*) The poor level of understanding of most political advisors about AGI, and their tendency to push discussions back to the issues of ANI
*) Risks of catastrophic social destabilisation if "the mother of all panics" about AGI occurs on top of existing culture wars and political tribalism
*) Past examples of progress with technologies that initially seemed impossible to govern
*) The importance of taking some initial steps forward, rather than being overwhelmed by the scale of the challenge.

Music: Spike Protein, by Koi Discovery, available under CC0 1.0 Public Domain Declaration

Selected follow-up reading:
https://en.wikipedia.org/wiki/Jerome_C._Glenn
https://www.millennium-project.org/
https://www.millennium-project.org/first-steps-for-artificial-general-intelligence-governance-study-have-begun/
The 2020 book "After Shock: The World's Foremost Futurists Reflect on 50 Years of Future Shock - and Look Ahead to the Next 50"


Promoguy Talk Pills
Agency in Amsterdam dives into topics like Tech, AI, digital marketing, and more drama...

Listen on: Apple Podcasts   Spotify

...more
View all episodesView all episodes
Download on the App Store

London FuturistsBy London Futurists

  • 5
  • 5
  • 5
  • 5
  • 5

5

8 ratings


More shows like London Futurists

View all
Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,326 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,005 Listeners

The Kevin Rose Show by Kevin Rose

The Kevin Rose Show

1,876 Listeners

FT Tech Tonic by Financial Times

FT Tech Tonic

100 Listeners

Hidden Forces by Demetri Kofinas

Hidden Forces

1,446 Listeners

The Peter Attia Drive by Peter Attia, MD

The Peter Attia Drive

7,868 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,107 Listeners

Last Week in AI by Skynet Today

Last Week in AI

281 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

8,758 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

352 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

395 Listeners

Moonshots with Peter Diamandis by PHD Ventures

Moonshots with Peter Diamandis

465 Listeners

"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis by Erik Torenberg, Nathan Labenz

"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

85 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

196 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

72 Listeners