Doom Debates!

Jobst Landgrebe, co-author of Why Machines Will Never Rule The World: Artificial Intelligence Without Fear, argues that AI is fundamentally limited in achieving human-like intelligence or consciousness due to the complexities of the human brain which are beyond mathematical modeling.

Contrary to my view, Jobst has a very low opinion of what machines will be able to achieve in the coming years and decades.

He’s also a devout Christian, which makes our clash of perspectives funnier.

00:00 Introduction

03:12 AI Is Just Pattern Recognition?

06:46 Mathematics and the Limits of AI

12:56 Complex Systems and Thermodynamics

33:40 Transhumanism and Genetic Engineering

47:48 Materialism

49:35 Transhumanism as Neo-Paganism

01:02:38 AI in Warfare

01:11:55 Is This Science?

01:25:46 Conclusion

Source podcast: https://www.youtube.com/watch?v=xrlT1LQSyNU

Join the conversation at DoomDebates.com or youtube.com/@DoomDebates, suggest topics or guests, and help us spread awareness about the urgent risk of AI extinction. Thanks for watching.

Today I’m reacting to the 20VC podcast with Harry Stebbings and Princeton professor Arvind Narayanan.

Prof. Narayanan is known for his critical perspective on the misuse and over-hype of artificial intelligence, which he often refers to as “AI snake oil”. Narayanan’s critiques aim to highlight the gap between what AI can realistically achieve, and the often misleading promises made by companies and researchers.

I analyze Arvind’s takes on the comparative dangers of AI and nuclear weapons, the limitations of current AI models, and AI’s trajectory toward being a commodity rather than a superintelligent god.

00:00 Introduction

01:21 Arvind’s Perspective on AI

02:07 Debating AI's Compute and Performance

03:59 Synthetic Data vs. Real Data

05:59 The Role of Compute in AI Advancement

07:30 Challenges in AI Predictions

26:30 AI in Organizations and Tacit Knowledge

33:32 The Future of AI: Exponential Growth or Plateau?

36:26 Relevance of Benchmarks

39:02 AGI

40:59 Historical Predictions

46:28 OpenAI vs. Anthropic

52:13 Regulating AI

56:12 AI as a Weapon

01:02:43 Sci-Fi

01:07:28 Conclusion

Original source: https://www.youtube.com/watch?v=8CvjVAyB4O4

Follow Arvind Narayanan: x.com/random_walker

Follow Harry Stebbings: x.com/HarryStebbings

Join the conversation at DoomDebates.com or youtube.com/@DoomDebates, suggest topics or guests, and help us spread awareness about the urgent risk of AI extinction. Thanks for watching.

Today I’m reacting to the Bret Weinstein’s recent appearance on the Diary of a CEO podcast with Steven Bartlett. Bret is an evolutionary biologist known for his outspoken views on social and political issues.

Bret gets off to a promising start, saying that AI risk should be “top of mind” and poses “five existential threats”. But his analysis is shallow and ad-hoc, and ends in him dismissing the idea of trying to use regulation as a tool to save our species from a recognized existential threat.

I believe we can raise the level of AI doom discourse by calling out these kinds of basic flaws in popular media on the subject.

00:00 Introduction

02:02 Existential Threats from AI

03:32 The Paperclip Problem

04:53 Moral Implications of Ending Suffering

06:31 Inner vs. Outer Alignment

08:41 AI as a Tool for Malicious Actors

10:31 Attack vs. Defense in AI

18:12 The Event Horizon of AI

21:42 Is Language More Prime Than Intelligence?

38:38 AI and the Danger of Echo Chambers

46:59 AI Regulation

51:03 Mechanistic Interpretability

56:52 Final Thoughts

Original source: youtube.com/watch?v=_cFu-b5lTMU

Follow Bret Weinstein: x.com/BretWeinstein

Follow Steven Bartlett: x.com/StevenBartlett

Join the conversation at DoomDebates.com or youtube.com/@DoomDebates, suggest topics or guests, and help us spread awareness about the urgent risk of AI extinction. Thanks for watching.

California's SB 1047 bill, authored by CA State Senator Scott Wiener, is the leading attempt by a US state to regulate catastrophic risks from frontier AI in the wake of President Biden's 2023 AI Executive Order.

Today’s debate:

Holly Elmore, Executive Director of Pause AI US, representing Pro- SB 1047

Greg Tanaka, Palo Alto City Councilmember, representing Anti- SB 1047

Key Bill Supporters: Geoffrey Hinton, Yoshua Bengio, Anthropic, PauseAI, and about a 2/3 majority of California voters surveyed.

Key Bill Opponents: OpenAI, Google, Meta, Y Combinator, Andreessen Horowitz

Links

Greg mentioned that the "Supporters & Opponents" tab on this page lists organizations who registered their support and opposition. The vast majority of organizations listed here registered support against the bill: https://digitaldemocracy.calmatters.org/bills/ca_202320240sb1047

Holly mentioned surveys of California voters showing popular support for the bill:1. Center for AI Safety survey shows 77% support: https://drive.google.com/file/d/1wmvstgKo0kozd3tShPagDr1k0uAuzdDM/view2. Future of Life Institute survey shows 59% support: https://futureoflife.org/ai-policy/poll-shows-popularity-of-ca-sb1047/

Follow Holly: x.com/ilex_ulmus

Follow Greg: x.com/GregTanaka

Join the conversation on DoomDebates.com or youtube.com/@DoomDebates, suggest topics or guests, and help us spread awareness about the urgent risk of extinction. Thanks for watching.

Today I’m reacting to David Shapiro’s response to my previous episode, and also to David’s latest episode with poker champion & effective altruist Igor Kurganov.

I challenge David's optimistic stance on superintelligent AI inherently aligning with human values. We touch on factors like instrumental convergence and resource competition. David and I continue to clash over whether we should pause AI development to mitigate potential catastrophic risks. I also respond to David's critiques of AI safety advocates.

00:00 Introduction

01:08 David's Response and Engagement

03:02 The Corrigibility Problem

05:38 Nirvana Fallacy

10:57 Prophecy and Faith-Based Assertions

22:47 AI Coexistence with Humanity

35:17 Does Curiosity Make AI Value Humans?

38:56 Instrumental Convergence and AI's Goals

46:14 The Fermi Paradox and AI's Expansion

51:51 The Future of Human and AI Coexistence

01:04:56 Concluding Thoughts

Join the conversation on DoomDebates.com or youtube.com/@DoomDebates, suggest topics or guests, and help us spread awareness about the urgent risk of extinction. Thanks for listening.

Maciej Ceglowski is an entrepreneur and owner of the bookmarking site Pinboard. I’ve been a long-time fan of his sharp, independent-minded blog posts and tweets.

In this episode, I react to a great 2016 talk he gave at WebCamp Zagreb titled Superintelligence: The Idea That Eats Smart People. This talk was impressively ahead of its time, as the AI doom debate really only heated up in the last few years.

---

00:00 Introduction

02:13 Historical Analogies and AI Risks

05:57 The Premises of AI Doom

08:25 Mind Design Space and AI Optimization

15:58 Recursive Self-Improvement and AI

39:44 Arguments Against Superintelligence

45:20 Mental Complexity and AI Motivations

47:12 The Argument from Just Look Around You

49:27 The Argument from Life Experience

50:56 The Argument from Brain Surgery

53:57 The Argument from Childhood

58:10 The Argument from Robinson Crusoe

01:00:17 Inside vs. Outside Arguments

01:06:45 Transhuman Voodoo and Religion 2.0

01:11:24 Simulation Fever

01:18:00 AI Cosplay and Ethical Concerns

01:28:51 Concluding Thoughts and Call to Action

---

Follow Maciej: x.com/pinboard

Follow Doom Debates:

* youtube.com/@DoomDebates

* DoomDebates.com

* x.com/liron

* Search “Doom Debates” in your podcast player

Today I’m reacting to David Shapiro’s latest YouTube video: “Pausing AI is a spectacularly bad idea―Here's why”.

In my opinion, every plan that doesn’t evolve pausing frontier AGI capabilities development now is reckless, or at least every plan that doesn’t prepare to pause AGI once we see a “warning shot” that enough people agree is terrifying.

We’ll go through David’s argument point by point, to see if there are any good points about why maybe pausing AI might actually be a bad idea.

00:00 Introduction

01:16 The Pause AI Movement

03:03 Eliezer Yudkowsky’s Epistemology

12:56 Rationalist Arguments and Evidence

24:03 Public Awareness and Legislative Efforts

28:38 The Burden of Proof in AI Safety

31:02 Arguments Against the AI Pause Movement

34:20 Nuclear Proliferation vs. AI

34:48 Game Theory and AI

36:31 Opportunity Costs of an AI Pause

44:18 Axiomatic Alignment

47:34 Regulatory Capture and Corporate Interests

56:24 The Growing Mainstream Concern for AI Safety

Follow David:

* youtube.com/@DaveShap

* x.com/DaveShapi

Follow Doom Debates:

* DoomDebates.com

* youtube.com/@DoomDebates

* x.com/liron

John Sherman and I go through David Brooks’s appallingly bad article in the New York Times titled “Many People Fear AI. They Shouldn’t.”

For Humanity is basically the sister podcast to Doom Debates. We have the same mission to raise awareness of the urgent AI extinction threat, and build grassroots support for pausing new AI capabilities development until it’s safe for humanity.

Subscribe to it on YouTube: https://www.youtube.com/@ForHumanityPodcast

Follow it on X: https://x.com/ForHumanityPod

Dr. Richard Sutton is a Professor of Computing Science at the University of Alberta known for his pioneering work on reinforcement learning, and his “bitter lesson” that scaling up an AI’s data and compute gives better results than having programmers try to handcraft or explicitly understand how the AI works.

Dr. Sutton famously claims that AIs are the “next step in human evolution”, a positive force for progress rather than a catastrophic extinction risk comparable to nuclear weapons.

Let’s examine Sutton’s recent interview with Daniel Fagella to understand his crux of disagreement with the AI doom position.

---

00:00 Introduction

03:33 The Worthy vs. Unworthy AI Successor

04:52 “Peaceful AI”

07:54 “Decentralization”

11:57 AI and Human Cooperation

14:54 Micromanagement vs. Decentralization

24:28 Discovering Our Place in the World

33:45 Standard Transhumanism

44:29 AI Traits and Environmental Influence

46:06 The Importance of Cooperation

48:41 The Risk of Superintelligent AI

57:25 The Treacherous Turn and AI Safety

01:04:28 The Debate on AI Control

01:13:50 The Urgency of AI Regulation

01:21:41 Final Thoughts and Call to Action

---

Original interview with Daniel Fagella: youtube.com/watch?v=fRzL5Mt0c8A

Follow Richard Sutton: x.com/richardssutton

Follow Daniel Fagella: x.com/danfaggella

Follow Liron: x.com/liron

Subscribe to my YouTube channel for full episodes and other bonus content: youtube.com/@DoomDebates

David Pinsof is co-creator of the wildly popular Cards Against Humanity and a social science researcher at UCLA Social Minds Lab. He writes a blog called “Everything Is B******t”.

He sees AI doomers as making many different questionable assumptions, and he sees himself as poking holes in those assumptions.

I don’t see it that way at all; I think the doom claim is the “default expectation” we ought to have if we understand basic things about intelligence.

At any rate, I think you’ll agree that his attempt to poke holes in my doom claims on today’s podcast is super good-natured and interesting.

00:00 Introducing David Pinsof

04:12 David’s P(doom)

05:38 Is intelligence one thing?

21:14 Humans vs. other animals

37:01 The Evolution of Human Intelligence

37:25 Instrumental Convergence

39:05 General Intelligence and Physics

40:25 The Blind Watchmaker Analogy

47:41 Instrumental Convergence

01:02:23 Superintelligence and Economic Models

01:12:42 Comparative Advantage and AI

01:19:53 The Fermi Paradox for Animal Intelligence

01:34:57 Closing Statements

Follow David: x.com/DavidPinsof

Follow Liron: x.com/liron

Thanks for watching. You can support Doom Debates by subscribing to the Substack, the YouTube channel (full episodes and bonus content), subscribing in your podcast player, and leaving a review on Apple Podcasts.