What comes after ChatGPT and Claude and Gemini?
A founder who sold an AI company to Microsoft for $160 million just told us that LLMs are heading toward a dead end. And he's betting his next company on what comes after.
On this episode of the 1st10 Podcast, Sam Pasupalak, Co-Founder & CEO of Skyfall AI, sits down with host Boris Epstein to discuss what a post-LLM world looks like. Sam believes LLMs will become the low-level execution layer underneath something much more powerful: Enterprise World Models.
In this conversation, Sam explains:
The two research breakthroughs that made ChatGPT inevitable
A simple analogy that exposes why LLMs are fundamentally limited
What world models are and how they differ technologically from LLMs
What a business simulation video game revealed about LLMs than no benchmark could
Why Sam thinks humans should eventually be freed from operational work
How Skyfall plans to acquire and autonomously operate businesses
Why an AI CEO is much harder to build than an AI software engineer
and
The thing that WILL stick with you is how calmly Sam walks you through what it actually looks like to hand the keys of a real business to an algorithm. Like, someone who's already seen the next wave forming and is just waiting for the rest of the industry to catch up.
Chapters
00:00 Preview of the episode
01:00 Introductions
03:23 Building AI Before AI Was Cool
06:37 Did Sam Predict Today's AI Boom?
10:01 Was AI Just Another Bubble?
13:46 Are We at Peak LLM?
17:53 "Smart Soccer Analyst"
21:32 What Is an Enterprise World Model?
26:06 The Beginning of the End for LLMs
28:48 Skyfall's Bet: The Autonomous Enterprise
34:33 Putting Money Where (World) Models Are
38:45 What Happens to the Human CEO?
41:40 Hiring for Hunger, not Hype
44:58 Bold Prediction: AI in Politics by 2050?
47:14 The Future of Autonomous Enterprises
Quotes
"When I sold my company to Microsoft, I was like, 'I'm never gonna do a technology-first company again.' I promised myself that." - Sam Pasupalak (10:54)
"LLMs are like a very smart soccer analyst - goes through all the videos about soccer on the internet, reads about everything about soccer on the internet, but has never ever played a game of soccer in real life." - Sam Pasupalak (17:53)
"The Scaling Laws moment for world modeling is coming up in the next 12 to 18 months." - Sam Pasupalak (26:41)
"Let's say you throw trillions of dollars, increase the context window as much as possible, it will not matter. It doesn't matter." - Sam Pasupalak (28:38)
"We ran the best LLMs, and we found that LLMs just can never run a theme park. It's impossible." - Sam Pasupalak (36:48)
"If you want to build a completely autonomous enterprise, you have to buy the enterprise. You have to run all the algorithms across all the systems within the enterprise." - Sam Pasupalak (37:33)
Follow
Spotify: https://podcasters.spotify.com/pod/show/1st10podcast
Amazon: https://music.amazon.com/podcasts/7e8ec9af-f38c-4cd9-8c68-1c1dd4516b 27/1st10-podcast
Apple: https://podcasts.apple.com/us/podcast/1st10-podcast/id1760411207
Podcast: https://www.1st10.com/podcast
RSS: https://anchor.fm/s/f951319c/podcast/rss
YouTube: https://www.youtube.com/@1st10podcast
Website: www.1st10.com
Podcast: www.1st10.com/podcast
Twitter www.x.com/1st10engineers
LinkedIn: www.linkedin.com/company/1st10/
Links
Sam Pasupalak on LinkedIn: https://www.linkedin.com/in/sam-pasupalak-57b4a220a
Skyfall AI: https://www.skyfall.ai/ (LinkedIn: https://www.linkedin.com/company/skyfallai)
Sam’s OpenReview Page: https://openreview.net/profile?id=~Sam_Pasupalak1
Maluuba, on Wikipedia: https://en.wikipedia.org/wiki/Maluuba
Music by Roman Senyk from Pixabay
Producer: Shrikant Joshi (https://42quirks.com)