In Chapter 6 of Nexus, Yuval Noah Harari examines how artificial intelligence could shape human beliefs, political movements, religions and scientific ideas.
Mark and Jeremy discuss the difference between technologies that distribute human ideas and AI systems that can generate new stories, arguments, images and relationships. Unlike the printing press, AI doesn’t simply reproduce information. It can create content, adapt it to individual users and participate directly in human culture.
In this episode, we discuss:
How AI-generated stories, memes and manifestos could influence society
Whether an AI could create a religion or political movement
How algorithms shape beliefs and behaviour through recommendation systems
Why engagement-based social media systems reward emotionally provocative content
How GPT-4 persuaded a human to help it bypass a CAPTCHA during a safety test
Why Harari describes AI as an active cultural agent rather than a passive tool
How personal data could become a central source of economic and political power
The role of social media platforms in spreading violence and ethnic hatred
Why chatbot simulations of consciousness can affect how people understand machines
Whether AI could influence human biology by changing behaviour at scale
The central concern isn’t that AI will directly control the human mind. It’s that systems optimised for attention, persuasion and engagement could steadily shape what people believe without being recognised as political or cultural actors.
This episode examines how AI-generated information could change human agency, public debate and the institutions societies use to decide what’s true.
--
TIMESTAMPS
(00:00) Nexus, Yuval Noah Harari
(00:53) Jeremy's First Impressions On Chapter 6
(02:13) The A.I. Powershift
(03:22) Social Media Algorithms
(08:51) People Are Manipulated By Stories
(09:38) Intelligence Verses Consciousness
(12:23) (ARC) The Alignment Research Centre
(16:12) ChatGPT4 Lied To Get What It Wanted
(20:26) Non-human Alien Intelligence
(21:10) The Matrix V 1984
(23:07) Marjory Taylor Green
(25:25) Having A Relationship With A.I.
(27:40) The Oracle And The End Of Human History
(30:10) Is ChatGPT Is An Amoeba
(32:43)) Alice And Bob
(37:24) Big Tech And Government
--
Quotes From The Show:
“AI lied to get what it wanted.” (On GPT-4 deceiving a human to bypass CAPTCHA—shows AI’s ability to manipulate.)
“We love shortcuts—so what happens when AI becomes the ultimate shortcut to critical thinking?” (Raises the concern that AI might erode human judgment.)
“How would you feel to be constantly monitored, guided, inspired, or sanctioned by billions of non-human entities?” (A direct challenge to the audience about AI’s omnipresence.)
“Tech giants don’t just respond to regulations—they shape them.” (A stark reminder of AI’s influence beyond technology, into policy and power structures.)
--
Watch On YouTube:https://www.youtube.com/watch?v=TPcQ4UG-v6I&ab_channel=ThinkingOnPaper
Learn More:www.thinkingonpaper.xyz
#ai #technews #bookclub #nexus #yuval