They Might Be Self-Aware

Llama 4 Caught Cheating Benchmarks? Meta Under Fire!


Listen Later

⏱️ CHAPTERS
00:00:00 – Metaverse banter
00:01:28 - Meta drops Llama 4: size, MoE architecture & first‑day hype
00:03:03 - “Cheating the test?” How Llama 4 climbed then fell on leaderboards
00:07:15 - Broken benchmarks, GPU tricks & lessons from 2000‑era graphics cards
00:11:16 - Should we trust today’s AI leaderboards? Transparency + corporate ties
00:16:15 - AB testing 101 and why secret “mystery models” exist
00:18:13 - Model chaos at OpenAI: GPT‑4.1, o‑series, mini models & naming mess
00:24:28 - OpenAI = Salesforce of AI? Windsurf acquisition & product sprawl
00:26:33 - Sam Altman’s “10× productivity” promise—what it really means
00:27:15 - Will coders vanish or just do more? History of tech‑driven expectations
00:30:55 - Conspiracy corner: GPT‑4.5 passed the Turing Test… then got axed
00:34:45 - Wrap Up

...more
View all episodesView all episodes
Download on the App Store

They Might Be Self-AwareBy Daniel Bishop, Hunter Powers