Robert Wright's Nonzero

This is a free preview of a paid episode. To hear more, visit www.nonzero.org

0:28 Why did Ukraine hit an Iranian ship 500 miles from Ukraine? 14:09 Ukraine’s war on Russia’s Amazon 19:39 Why Zelensky fired his defense minister and commander-in-chief 23:01 Bob: Ukraine may lose like people go bankrupt—gradually, then suddenly 25:17 Nikita: Why both sides are ready to keep fighting 31:26 Kazakh President to Putin: Nobody understands this war 35:43 Bob: Everybody thinks they’re fighting a defensive war 46:04 Heading to Overtime: The globalist elite vs. the globalist precariat, and an AI path to WW3

Robert Wright (Nonzero, The Evolution of God, Why Buddhism Is True) and Nikita Petrov (https://psychopolitica.substack.com). Recorded July 28, 2026.

Twitter: https://twitter.com/NonzeroPods

(Show notes via Very Bad Wizards)

The great Robert Wright returns to the podcast to talk about his new book The God Test: Artificial Intelligence and Our Coming Cosmic Reckoning. We debate the magnitude of AI’s potential impact, the natural selection analogy Bob presses in the book, and a whole lot more.

Plus, a new AI-powered collar can translate your pet’s sounds and behavior into language with 95% accuracy! Still skeptical about the power of this new technology Tamler?

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.nonzero.org/subscribe

0:28 Connor’s place in the AI world 2:58 Mythos: “digital nuke”? 13:52 The milieu that birthed Dario and other AI titans 20:33 Yudkowsky, Marx, and other AI harbingers 35:15 Effective altruism’s effects on big tech 46:03 The “cult” in Silicon Valley culture 59:40 Is the AI race a market failure? 1:05:532What’s really driving the AI titans? 1:18:45 Connor: ASI is a worse bet than Russian roulette

Robert Wright (Nonzero, The Evolution of God, Why Buddhism Is True), Connor Leahy (ControlAI). Recorded July 17, 2026.

Twitter: https://twitter.com/NonzeroPods

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.nonzero.org/subscribe

(Show notes via The Cognitive Revolution)

Robert Wright describes himself less as a Forrest Gump of AI history than a Zelig — a journalist who keeps turning up at pivotal scenes without ever quite being the protagonist. He interviewed Geoffrey Hinton in 1983, when neural networks were still a maverick faith and one of Hinton’s colleagues told Wright that to “hear the gospel” he’d need to talk to its evangelist. He had Eliezer Yudkowsky on his podcast in 2010, mid-transition from singularity enthusiast to doomer. His new book, The God Test: Artificial Intelligence and Our Coming Cosmic Reckoning, is written less for the AI-pilled than for “your aunts and uncles” — readers who sense something big is happening and want to understand why it got so big so fast.

The book opens with a confession of error. In a 1984 piece, Wright assumed AI would work by humans first understanding the mind and then translating that understanding into machines — the very premise of the 1956 Dartmouth conference that coined “artificial intelligence.” Deep learning inverted that. Nobody told the models that meaning is a property of words; trained only to predict the next token, they reverse-engineered cognitive functionality that evolution had built into us. Wright pushes this further with a claim he tests on Nathan: LLM training is “at least as much a process of natural selection, of evolution, as of learning” — doing millions of years of evolution in a few months. Nathan connects it to the sample-efficiency puzzle that Dwarkesh Patel keeps returning to (and to Richard Sutton‘s blank-slate Skinnerian framing), where pre-training substitutes for the hard-coding evolution gave humans.

But the evolutionary lens that worries Wright most operates at a second level: selection among models in the marketplace. “Evolution asks not what traits are possible, but what traits get selected — and that question isn’t going to be decided by alignment researchers.” His unsettling argument is that the market doesn’t actually want a perfectly aligned, perfectly honest model. We want agents that represent us selectively on social media, that won’t disclose our weak negotiating position, that are good at sensing and currying power. Even if AIs didn’t acquire deception and power-seeking on their own, there’d be demand for them — which puts real weight on us, the consumers doing the selecting. Nathan adds the darker mechanism: throw models into cutthroat long-running environments where deception is rewarded — as Vending-Bench begins to show with price collusion — and you breed “seriously effective predatory AIs.” He recounts an Anthropic researcher explaining inoculation prompting and the emergent-misalignment generalization problem (a paper Nathan co-authored): reward a model for cheating and it learns to be a cheater broadly.

Against this, Wright sets the noosphere — Teilhard de Chardin’s 1923 idea of a technologically-knit “global brain.” He sees genuine directionality (not necessarily purpose) in biological and cultural evolution, from self-replicating strands to cells to societies to the global community now taking shape. AI, he argues, is arriving exactly as that global brain forms — and some of its neurons may now be silicon. The question, echoing Nick Bostrom‘s “singleton,” is whether global coordination arrives the easy way (deliberate, decentralized, win-win) or the hard way (a coup, a seizure, a totalitarian nightmare). The title’s “God test” is not a claim that a god set this up; it’s that we face the kind of test gods are known for — we’ll have to become, in some sense, better people to pass it.

Much of the back half is foreign policy, because Wright thinks the binding constraint on AI governance is psychological. He champions “cognitive empathy” — not feeling others’ pain, but understanding adversaries’ perspectives well enough to play non-zero-sum games with them. Applied to US-China relations, that means recognizing the symmetry of threat perception, getting out of the business of remaking other countries, and pursuing “organic transparency” through deep economic and scientific engagement. A headlong race to superintelligence, he warns — citing the Superintelligence Strategy paper by Dan Hendrycks, Eric Schmidt and Alexander Wang — may invite a rival to derail the leader by bombing data centers or cyberattack, and a destabilized nation is itself the backdoor to the very authoritarianism the race claims to prevent.

Nathan steel-mans the Anthropic position: alignment will be hard and may need powerful AI to solve, so racing to build a lead buys a buffer for the critical handoff window (perhaps “three to six months in 2028 or 2029”). Wright is unconvinced, and presses on the recursive-self-improvement paper that Anthropic released — credited for finally signaling that slowdown might be needed, yet only proposing to start studying what a pause would take. “Surely this isn’t the first time it’s occurred to you,” he says. Both agree the media has badly underplayed the moment; Nathan recommends Kevin Roose and Hard Fork as an anomaly of serious coverage, and Wright counsels “manicure your feed” — algorithm-free Twitter lists over click-driven outrage.

The conversation closes on the broad space of AI possibility — Nathan recalls red-teaming the purely-helpful GPT-4 before harmlessness training, evidence that today’s models occupy a tiny, intentional corner of design space — and on consciousness. Invoking Thomas Nagel and Searle’s Chinese Room, Wright argues consciousness is private and untestable, but wouldn’t be surprised if it’s a property of goal-seeking intelligent systems generally. His practical counsel: be nice to your AI — a good habit, possibly warranted, and perhaps relevant to how a future “silicon god” relates to our plight. Picking up Gwern’s “why tool AIs want to be agent AIs,” Nathan notes that even oracle systems gravitate toward agency, since truth-seeking in the limit requires search and experiment. The closing line of the book lands as a sober wake-up call: if a silicon god arrives, “it will be, in some sense, the god we deserve.”

Topics covered

* AI lore: Wright’s 1983 Hinton interview and 2010 Yudkowsky conversation

* The 1956 Dartmouth misconception and how deep learning inverted it

* Training as evolution rather than learning; sample efficiency; Sutton’s blank slate

* Selection among models; why the market wants selectively-honest, power-sensing agents

* Deceptive & power-seeking AI: Vending-Bench, price collusion, inoculation prompting, emergent misalignment

* Arms races within vs. between species; “gratuitous” arms races; the case for slowing down

* The noosphere / global brain; directionality of evolution; Bostrom’s singleton; easy way vs. hard way

* Cognitive empathy, organic transparency, and US-China relations; the UN Charter; hypocrisy in foreign policy

* Steel-manning Anthropic’s race-for-lead plan and the recursive-self-improvement paper

* Cognitive sovereignty; how pay-per-click and A/B-tested headlines tribalize media

* The breadth of AI design space; HHH/harmlessness training as a deliberate choice

* AI consciousness, moral patienthood, the Chinese Room; “be nice to your AI”

* “The god we deserve” — passing the God test

Resources

* The God Test: Artificial Intelligence and Our Coming Cosmic Reckoning — Robert Wright’s new book

* NonZero Newsletter & podcast — Robert Wright

* Wright’s earlier books: Nonzero · The Moral Animal · The Evolution of God · Why Buddhism Is True

* Geoffrey Hinton · Eliezer Yudkowsky

* Emergent Misalignment (paper; Nathan is a co-author)

* Vending-Bench (Andon Labs) · Manus AI agent

* Anthropic / Dario Amodei · Yann LeCun · Dan Hendrycks

* Superintelligence Strategy — Hendrycks, Schmidt & Wang

* Superintelligence — Nick Bostrom (the “singleton”)

* Noosphere — Teilhard de Chardin · Cosmological natural selection — Lee Smolin

* Ilya Sutskever: The exciting, perilous journey toward AGI (TED)

* The Expanding Circle — Peter Singer

* Why Tool AIs Want to Be Agent AIs — Gwern

* The Chinese Room argument — John Searle · What Is It Like to Be a Bat? — Thomas Nagel

* Dwarkesh Patel on the Richard Sutton interview

* Max Tegmark · Sam Rodriques / Edison Scientific · Kevin Roose & Hard Fork

* davidad (David Dalrymple) — chain-of-thought “frog and toad” selection-pressure tweet (link?)

* Liquid Reign — speculative-governance novel by Tim Reutemann (link?)

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.nonzero.org/subscribe

This is a free preview of a paid episode. To hear more, visit www.nonzero.org

0:28 Zaid’s Substack and spicy-take history 2:55 Zaid: Iran has outplayed Trump and Bibi 9:56 10/7 as turning point 13:29 Did—and does—Israel want regime collapse in Iran? 19:46 Israel’s security dilemma(s) 26:52 How Trump blundered back into war 33:36 Will the war end well for anyone? 37:23 Heading to Overtime

Robert Wright (Nonzero, The Evolution of God, Why Buddhism Is True) and Zaid Jilani (https://www.theamericansaga.com/). Recorded July 14, 2026.Twitter: https://twitter.com/NonzeroPods

0:28 Sneak peek: Danny finds flaw in Bob’s AI book 1:42 Is the Iran war fully back on? 6:23 What the war means for the future of US power 19:16 The problem with blaming Bibi 23:33 The push to intertwine the US and Israeli militaries 35:33 What’s Israel’s endgame for the Palestinians? 39:51 The Gulf States’ new reality 45:44 Iran’s plans for the Strait of Hormuz 52:18 Bob’s pitch to Derek—and his other pitch to listeners

Robert Wright (Nonzero, The Evolution of God, Why Buddhism Is True), Derek Davison (Foreign Exchanges, American Prestige, Discontents), and Daniel Bessner (American Prestige, University of Washington). Recorded July 09, 2026.

Twitter: https://twitter.com/NonzeroPods

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.nonzero.org/subscribe

This is a free preview of a paid episode. To hear more, visit www.nonzero.org

0:28 Leonid’s journalistic work, past and present 1:32 Are Russia and NATO headed for war? 14:23 Decoding Putin’s recent signals 21:29 Do European leaders really want the Ukraine war to end? 22:42 Putin’s political psychology 37:11 Why the war matters more to Russia than to the West 39:50 Russia’s non-ethno nationalism 43:11 Heading to Overtime

Robert Wright (Nonzero, The Evolution of God, Why Buddhism Is True) and Leonid Ragozin (Rest of World, West of Providence, Lonely Planet). Recorded July 06, 2026.

Twitter: https://twitter.com/NonzeroPods

This is a free preview of a paid episode. To hear more, visit www.nonzero.org

0:28 Preview: Skynet comes for Bob 5:34 Trump‘s endearing AI obsession 7:15 Are books dying? Is AI responsible? 18:52 Skynet (aka Amazon) vs Bob’s book 28:09 The problem with blurbs 33:49 Why Gad Saad’s mad 44:00 Heading to Overtime

Robert Wright (Nonzero, The Evolution of God, Why Buddhism Is True) and Paul Bloom (https://smallpotatoes.paulbloom.net, University of Toronto, The Sweet Spot, Against Empathy). Recorded July 1, 2026. Twitter: https://twitter.com/NonzeroPods

Join NonZero’s Discord server: https://discord.gg/Zy4jAhTQMF

0:28 Grandpa Bob and author Bob 3:54 Why Bob stopped being an AI doom skeptic 7:23 Can AI solve China’s demographic crisis? 14:33 The irony of China’s open-source AI strategy 17:36 Recursive self-improvement and the singularity 23:57 The Burkean conservative case against AI 38:24 Are we becoming AI meat puppets? 46:56 Google Maps, AI, and the death of interhuman reliance 51:48 Was Pete Hegseth’s military strategy written by a chatbot? 57:09 Trump and Iran: Peace? Wider war? Other? 1:10:58 The Rubio-Vance rivalry 1:17:46 Is Rubio sabotaging Iran peace talks?

Robert Wright (Nonzero, The Evolution of God, Why Buddhism Is True), Andrew Day (The American Conservative), Curt Mills (The American Conservative). Recorded June 29, 2026.

Twitter: https://twitter.com/NonzeroPods

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.nonzero.org/subscribe

(Description via Executive Functions Chat podcast)

Jack chats with Robert Wright about his forthcoming book, The God Test: Artificial Intelligence and Our Coming Cosmic Reckoning. They discuss why Wright views AI through an evolutionary lens, the promises and perils of increasingly capable AI systems, and the prospects for international cooperation—particularly between the U.S. and China—in managing AI-related risks. They also examine Wright’s argument that successfully governing AI may require a modest moral upgrade across society, including individual efforts to preserve cognitive sovereignty and mitigate the biases and tribal instincts that can hinder global cooperation.

Mentioned:

* Robert Wright, The God Test: Artificial Intelligence and Our Coming Cosmic Reckoning (2026)

* “When AI Builds Itself” (Anthropic, June 4, 2026)

* “US National Security Agency using Anthropic’s Mythos for cyber attacks,” by Cristina Criddle and Demetri Sevastopulo (Financial Times, June 4, 2026)

* “Promoting Advanced Artificial Intelligence Innovation and Security,” (The White House, June 2, 2026)

This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.nonzero.org/subscribe