London Futurists

Governing the transition to AGI, with Jerome Glenn


Listen Later

Our guest on this episode is someone with excellent connections to the foresight departments of governments around the world. He is Jerome Glenn, Founder and Executive Director of the Millennium Project.

The Millennium Project is a global participatory think tank established in 1996, which now has over 70 nodes around the world. It has the stated purpose to "Improve humanity's prospects for building a better world". The organisation produces regular "State of the Future" reports as well as updates on what it describes as "the 15 Global Challenges". It recently released an acclaimed report on three scenarios for the future of work. One of its new projects is the main topic in this episode, namely scenarios for the global governance of the transition from Artificial Narrow Intelligence (ANI) to Artificial General Intelligence (AGI).

Topics discussed in this episode include:
*) Why many futurists are jealous of Alvin Toffler
*) The benefits of a decentralised, incremental approach to foresight studies
*) Special features of the Millennium Project compared to other think tanks
*) How the Information Revolution differs from the Industrial Revolution
*) What is likely to happen if there is no governance of the transition to AGI
*) Comparisons with regulating the use of cars - and the use of nuclear materials
*) Options for licensing, auditing, and monitoring
*) How the development of a technology may be governed even if it has few visible signs
*) Three options: "Hope", "Control", and "Merge" - but all face problems; in all three cases, getting the initial conditions right could make a huge difference
*) Distinctions between AGI and ASI (Artificial Superintelligence), and whether an ASI could act in defiance of its initial conditions
*) Controlling AGI is likely to be impossible, but controlling the companies that are creating AGI is more credible
*) How actions taken by the EU might influence decisions elsewhere in the world
*) Options for "aligning" AGI as opposed to "controlling" it
*) Complications with the use of advanced AI by organised crime and by rogue states
*) The poor level of understanding of most political advisors about AGI, and their tendency to push discussions back to the issues of ANI
*) Risks of catastrophic social destabilisation if "the mother of all panics" about AGI occurs on top of existing culture wars and political tribalism
*) Past examples of progress with technologies that initially seemed impossible to govern
*) The importance of taking some initial steps forward, rather than being overwhelmed by the scale of the challenge.

Music: Spike Protein, by Koi Discovery, available under CC0 1.0 Public Domain Declaration

Selected follow-up reading:
https://en.wikipedia.org/wiki/Jerome_C._Glenn
https://www.millennium-project.org/
https://www.millennium-project.org/first-steps-for-artificial-general-intelligence-governance-study-have-begun/
The 2020 book "After Shock: The World's Foremost Futurists Reflect on 50 Years of Future Shock - and Look Ahead to the Next 50"


Real Talk About Marketing

An Acxiom podcast where we discuss marketing made better, bringing you real...

Listen on: Apple Podcasts   Spotify

...more
View all episodesView all episodes
Download on the App Store

London FuturistsBy London Futurists

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

9 ratings


More shows like London Futurists

View all
In Our Time by BBC Radio 4

In Our Time

5,389 Listeners

BBC Inside Science by BBC Radio 4

BBC Inside Science

401 Listeners

Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,462 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,032 Listeners

The Gray Area with Sean Illing by Vox

The Gray Area with Sean Illing

10,694 Listeners

Azeem Azhar's Exponential View by Azeem Azhar

Azeem Azhar's Exponential View

613 Listeners

Google DeepMind: The Podcast by Hannah Fry

Google DeepMind: The Podcast

198 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

407 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

442 Listeners

The Rest Is Politics by Goalhanger

The Rest Is Politics

3,276 Listeners

The News Agents by Global

The News Agents

981 Listeners

Moonshots with Peter Diamandis by PHD Ventures

Moonshots with Peter Diamandis

477 Listeners

The Rest Is Politics: Leading by Goalhanger

The Rest Is Politics: Leading

987 Listeners

The Rest Is Money by Goalhanger

The Rest Is Money

220 Listeners

The Rest Is Politics: US by Goalhanger

The Rest Is Politics: US

2,285 Listeners