How smart is OpenAI’s new model, o1? What does “reasoning” ACTUALLY mean? What do computability theory and complexity theory tell us about the limitations of LLMs?

Dr. Tim Scarfe and Dr. Keith Duggar, hosts of the popular Machine Learning Street Talk podcast, posted an interesting video discussing these issues… FOR ME TO DISAGREE WITH!!!

00:00 Introduction

02:14 Computability Theory

03:40 Turing Machines

07:04 Complexity Theory and AI

23:47 Reasoning

44:24 o1

47:00 Finding gold in the Sahara

56:20 Self-Supervised Learning and Chain of Thought

01:04:01 The Miracle of AI Optimization

01:23:57 Collective Intelligence

01:25:54 The Argument Against LLMs' Reasoning

01:49:29 The Swiss Cheese Metaphor for AI Knowledge

02:02:37 Final Thoughts

Original source: https://www.youtube.com/watch?v=nO6sDk6vO0g

Follow Machine Learning Street Talk: https://www.youtube.com/@MachineLearningStreetTalk

Zvi Mowshowitz's authoritative GPT-o1 post: https://thezvi.wordpress.com/2024/09/16/gpt-4o1/

Join the conversation at DoomDebates.com or youtube.com/@DoomDebates, suggest topics or guests, and help us spread awareness about the urgent risk of AI extinction. Thanks for watching.

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit lironshapira.substack.com