London Futurists

The AI disconnect: understanding vs motivation, with Nate Soares


Listen Later

Our guest in this episode is Nate Soares, President of the Machine Intelligence Research Institute, or MIRI.

MIRI was founded in 2000 as the Singularity Institute for Artificial Intelligence by Eliezer Yudkowsky, with support from a couple of internet entrepreneurs. Among other things, it ran a series of conferences called the Singularity Summit. In 2012, Peter Diamandis and Ray Kurzweil, acquired the Singularity Summit, including the Singularity brand, and the Institute was renamed as MIRI.

Nate joined MIRI in 2014 after working as a software engineer at Google, and since then he’s been a key figure in the AI safety community. In a blogpost at the time he joined MIRI he observed “I turn my skills towards saving the universe, because apparently nobody ever got around to teaching me modesty.”

MIRI has long had a fairly pessimistic stance on whether AI alignment is possible. In this episode, we’ll explore what drives that view—and whether there is any room for hope.

Selected follow-ups:

  • Nate Soares - MIRI
  • Yudkowsky and Soares Announce Major New Book: “If Anyone Builds It, Everyone Dies” - MIRI
  • The Bayesian model of probabilistic reasoning
  • During safety testing, o1 broke out of its VM - Reddit
  • Leo Szilard - Physics World
  • David Bowie - Five Years - Old Grey Whistle Test
  • Amara's Law - IEEE
  • Robert Oppenheimer calculation of p(doom)
  • JD Vance commenting on AI-2027
  • SolidGoldMagikarp - LessWrong
  • ASML
  • Chicago Pile-1 - Wikipedia
  • Castle Bravo - Wikipedia


Music: Spike Protein, by Koi Discovery, available under CC0 1.0 Public Domain Declaration

C-Suite Perspectives
Elevate how you lead with insight from today’s most influential executives.

Listen on: Apple Podcasts   Spotify

...more
View all episodesView all episodes
Download on the App Store

London FuturistsBy London Futurists

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

9 ratings


More shows like London Futurists

View all
More or Less by BBC Radio 4

More or Less

861 Listeners

The Documentary Podcast by BBC World Service

The Documentary Podcast

1,802 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,454 Listeners

This Week in Tech (Audio) by TWiT

This Week in Tech (Audio)

3,061 Listeners

Political Fix by Financial Times

Political Fix

154 Listeners

Azeem Azhar's Exponential View by Azeem Azhar

Azeem Azhar's Exponential View

615 Listeners

The Diary Of A CEO with Steven Bartlett by DOAC

The Diary Of A CEO with Steven Bartlett

8,855 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,163 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,213 Listeners

The Rest Is Politics by Goalhanger

The Rest Is Politics

3,831 Listeners

The News Agents by Global

The News Agents

1,241 Listeners

The Rest Is Politics: Leading by Goalhanger

The Rest Is Politics: Leading

861 Listeners

The News Agents - USA by Global

The News Agents - USA

405 Listeners

The Global Story by BBC World Service

The Global Story

389 Listeners

The Rest Is Politics: US by Goalhanger

The Rest Is Politics: US

2,523 Listeners