
Sign up to save your podcasts
Or


Blink and you missed it, but there have been 4 developments this week that could have major consequences. From a change of heart on maximising engagement from OpenAI - and doubts growing over whether to pursue superintelligence at all - to a startling new survey of 2778 AI researchers - full 38 page highlights. And predictions on the automation of human labor to the trillion-dollar titans fighting for quality data. Plus, my pick of the GPT store GPTs (hint Consensus is the best GPT for me!).
AI Insiders: https://www.patreon.com/AIExplained
Karpathy Intelligence Amplification: https://twitter.com/karpathy/status/1744179910347039080
Thousands of AI Authors on the Future of AI: https://arxiv.org/abs/2401.02843
Richard Ngo Tweet: https://twitter.com/RichardMCNgo/status/1735571667420598737
Brockman Tweet: https://www.nytimes.com/2023/03/31/technology/sam-altman-open-ai-chatgpt.html
Altman Testimony: https://www.youtube.com/watch?v=TO0J2Yw7usM
GPT Store Engagement: https://openai.com/blog/introducing-the-gpt-store
Character AI Catch-up: https://techcrunch.com/2023/09/11/ai-app-character-ai-is-catching-up-to-chatgpt-in-the-u-s/
Altman AI Waifus: https://twitter.com/sama/status/1745135061731803571
Daniel Gross Moat: https://twitter.com/danielgross/status/1744939910606508418
Consensus: https://twitter.com/ConsensusNLP/status/1724872225780625419
Superalignment Timeline: https://openai.com/blog/introducing-superalignment
Governance of Superintelligence: https://openai.com/blog/governance-of-superintelligence
FT Altman: https://www.ft.com/content/dd9ba2f6-f509-42f0-8e97-4271c7b84ded
OpenAI AGI Definition of AGI Automating Human Labor: https://openai.com/blog/how-should-ai-systems-behave#fn-A
Axel Springer: https://openai.com/blog/axel-springer-partnership
Fox and CNN Data: https://www.bloomberg.com/news/articles/2024-01-10/openai-in-talks-with-cnn-fox-and-time-to-license-content?srnd=premium-uk
OpenAI and Apple Negotiate Data: https://www.theinformation.com/articles/openai-offers-publishers-as-little-as-1-million-a-year?rc=sy0ihq
Mamba Video: https://www.youtube.com/watch?v=Xq-QEd1jpKk
Altman $100 Trillion: https://www.nytimes.com/2023/03/31/technology/sam-altman-open-ai-chatgpt.html
Inflection.ai Pi
Reza Mortazavi renders: https://twitter.com/MortazaviiiReza/status/1744678466635661381
Guardian CES: https://www.theguardian.com/technology/2024/jan/12/transparent-tvs-ai-catflaps-tech-standouts-ces-2024
AI binoculars: https://twitter.com/rowancheung/status/1745099409757520357
AI Insiders: https://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/
Learn more about your ad choices. Visit megaphone.fm/adchoices
This video will give nine more insights from the bombshell GPT 4 Technical Report. It is the companion video to the '14 Crazy Details' released the day before. In this video, I will cover:
Tests on how to 'shut down' the model in the wild, and how that might go wrong. Sam Altman requesting more regulation (!), milestone moments for humanity as more benchmarks fall, a hidden constitution, why GPT 5 might already be trained and much more.
Technical Report: https://cdn.openai.com/papers/gpt-4.pdf
Altman Tweet: https://twitter.com/sama/status/1635136281952026625
Leaked Conversation: https://www.axios.com/2023/03/14/microsoft-google-generative-ai-office
AGI Definition: https://openai.com/blog/planning-for-agi-and-beyond
Superforecasters: https://goodjudgment.com/
HellaSwag: https://arxiv.org/pdf/1905.07830.pdf
H100s: https://www.nvidia.com/en-us/data-center/h100/
GitHub Experiment: https://arxiv.org/pdf/2302.06590.pdf
Productivity: https://economics.mit.edu/sites/default/files/inline-files/Noy_Zhang_1.pdf#:~:text=We%20examine%20the%20productivity%20effects%20of%20a%20generative,andheightens%20both%20concern%20and%20excitement%20about%20automation%20technologies.
Ark Analysis: https://research.ark-invest.com/hubfs/1_Download_Files_ARK-Invest/Big_Ideas/ARK%20Invest_013123_Presentation_Big%20Ideas%202023_Final.pdf
Anthropic Constitution: https://arxiv.org/pdf/2212.08073.pdf
https://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/
Learn more about your ad choices. Visit megaphone.fm/adchoices
Here are 8 things that might have surprised you 6 weeks ago, let alone 6 months ago. From text to video to Ted Talks, I try to cover it all.
Nvidia Text to Video https://research.nvidia.com/labs/toronto-ai/VideoLDM/
Blockade Labs Tweet: https://twitter.com/BlockadeLabs/status/1648476832730349570
And Demo: https://www.blockadelabs.com/
Zip NeRF: https://jonbarron.info/zipnerf/
Paper: https://arxiv.org/pdf/2304.08818.pdf
Apple Reality Pro: https://www.tomsguide.com/news/the-apple-reality-pro-headset-sounds-downright-magical-as-patent-reveals-new-details
https://www.bloomberg.com/news/articles/2023-04-18/apple-vr-ar-headset-apps-sports-tv-fitness-gaming-wellness-ipad-features
Sony Award: https://edition.cnn.com/style/article/ai-photo-win-sony-scli-intl/index.html
Midjourney Progression: https://twitter.com/Pizza_Later
AI Dilemma: https://www.youtube.com/watch?v=xoVJKj8lcNQ&t=3600s
AI Poker: https://www.nytimes.com/2022/01/18/magazine/ai-technology-poker.html
Predicting Markets: https://www.youtube.com/watch?v=Q74jH9jBVF0
Fedspeak: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4399406
Paper: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4412788
Character AI: https://beta.character.ai/
Google Samsung: https://www.nytimes.com/2023/04/16/technology/google-search-engine-ai.html
Bard Reports: https://www.bloomberg.com/news/features/2023-04-19/google-bard-ai-chatbot-raises-ethical-concerns-from-employees?leadSource=uverify%20wall
Ted Attendees: https://blog.ted.com/the-astounding-new-era-of-ai-notes-on-session-2-of-ted2023/
ARC: https://www.alignment.org/
P(Doom): https://astralcodexten.substack.com/p/why-i-am-not-as-much-of-a-doomer
GPT 4 Technical Report: https://arxiv.org/abs/2303.08774
Altman Comments: https://www.youtube.com/watch?v=dXhoTrU1Kkw&t=119s
https://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/
Learn more about your ad choices. Visit megaphone.fm/adchoices
I just read the entire technical report on GPT 4, not just the promotional hype. And boy does it have some interesting details. I have gathered the 14 extra details that you, or at least the media, may miss from the release. The last one is more than a little wild.
These include things like the training secrets, the cherry-picked bar exam stat, text-to-image breakthroughs, and some truly astounding safety checks.
https://www.patreon.com/AIExplained
https://cdn.openai.com/papers/gpt-4.pdf
https://www.bemyeyes.com/
https://arxiv.org/pdf/2104.12756.pdf
https://arxiv.org/pdf/2203.10244.pdf
https://chat.openai.com/chat?model=gpt-4
https://arxiv.org/pdf/2302.10329.pdf
https://www.alignmentforum.org/posts/Aq82XqYhgqdPdPrBA/full-transcript-eliezer-yudkowsky-on-the-bankless-podcast Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/
Learn more about your ad choices. Visit megaphone.fm/adchoices
In the last few days, we have had dramatic new leaked insights into the sheer breadth of Google Gemini, their rival to GPT 4 or, perhaps, GPT 5. Just today, we’ve had Meta’s Code Llama and, earlier, their impressive multilingual SeamlessM4T model. Yesterday, from Berkley we get new brain-computer AI transforming the life of a stroke victim, and last but definitely not least, an 88 page AI Consciousness Report.
https://www.patreon.com/AIExplained
Code Llama Release Notes: https://ai.meta.com/blog/code-llama-large-language-model-coding/
Code Llama Paper: https://scontent.ftlv6-1.fna.fbcdn.net/v/t39.2365-6/369856151_1754812304950972_1159666448927483931_n.pdf?_nc_cat=107&ccb=1-7&_nc_sid=3c67a6&_nc_ohc=BnkB4kcpz5AAX-BLEnm&_nc_ht=scontent.ftlv6-1.fna&oh=00_AfDMXBh-sI8So-Q0Og4A77uRrdLsTiNwDGZQ3WFYQkNplA&oe=64ECB20F
The Information Gemini Article: https://www.theinformation.com/articles/the-forced-marriage-at-the-heart-of-googles-ai-race?rc=sy0ihq
NYT Google’s Life Advice: https://www.nytimes.com/2023/08/16/technology/google-ai-life-advice.html
Google Deepmind Chips: https://www.wsj.com/articles/in-race-for-ai-chips-google-deepmind-uses-ai-to-design-specialized-semiconductors-dcd78967
AI Paralyzed Woman: https://www.ucsf.edu/news/2023/08/425986/how-artificial-intelligence-gave-paralyzed-woman-her-voice-back
SeamlessM4T: https://about.fb.com/news/2023/08/seamlessm4t-ai-translation-model/
Phi-1 Paper: https://arxiv.org/pdf/2306.11644.pdf
Phi-1 Video: https://www.youtube.com/watch?v=7S68y6huEpU&t=88s
Consciousness Paper: https://arxiv.org/pdf/2308.08708.pdf
Science Consciousness Interviews: https://www.science.org/content/article/if-ai-becomes-conscious-how-will-we-know
Sutskever Tweet: https://twitter.com/ilyasut/status/1491554478243258368?lang=en
Mathematical Consciousness Open Letter: https://amcs-community.org/open-letters/
Midjourney: https://www.midjourney.com/home/?callbackUrl=%2Fapp%2F
New AI Explained Discord! https://discord.gg/WxxeHG7HCV - Led by the amazing Wolffe#5102, a consultant and software developer focusing on AI-power applications.
https://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/
Learn more about your ad choices. Visit megaphone.fm/adchoices
Claude Fable 5 banned, but what’s the bigger story. We go through 11 under-reported details, so you have the context to see what’s coming next for your use of AI. From whether the ban will last, what the possible motives are, what the model can actually do, and some wild over-extrapolations going on.
Check out my fast-growing (!) app, free to use, and code INSIDER15 for paid tiers: https://lmcouncil.ai
AI Insiders ($9!): https://www.patreon.com/AIExplained
Chapters:
00:00 - Introduction
00:51 - Came from an Anthropic Investor ‘and other tech leaders’
01:47 - Govt pressured by CEOs like Jamie Dimon
03:01 - ‘Already decided’
04:02 - Prompt Injection Robustness Comparison
05:15 - Wellness?
06:36 - “Overreach”
08:17 - Anthropic Did Admit it would cause Difficulty
09:32 - 90 Minutes
10:02 - Equity Absence
10:31 - Lobbying and OpenAI
‘Already Decided’ - https://www.theinformation.com/articles/amazons-jassy-raised-concerns-anthropic-model-trump-crackdown?rc=sy0ihq
Not for Other Models: https://www.theinformation.com/briefings/u-s-government-unlikely-extend-anthropic-export-control-ai-companies?rc=sy0ihq
90 Minutes: https://archive.fo/20260614001605/https://www.politico.com/news/2026/06/13/inside-the-whirlwind-24-hours-that-led-the-white-house-to-slap-export-controls-on-anthropic-00961519#selection-807.1-807.219
Anthropic Statement: https://www.anthropic.com/news/fable-mythos-access
Life Comes at you Fast: https://x.com/etbrooking/status/2065638276388495742
Anthropic Deputy CISO: https://x.com/TheTranscript_/status/2065883670053847324
Hegseth Gloat: https://x.com/PeteHegseth/status/2065897156226015690
Roon Speculation: https://x.com/tszzl/status/2065939227167392147
Mythos System Card: https://www-cdn.anthropic.com/d00db56fa754a1b115b6dd7cb2e3c342ee809620.pdf
Sachs Statement: https://x.com/DavidSacks/status/2065853007619588171
OpenAI Lobbying: https://thehill.com/policy/technology/5912720-altman-openai-get-bogged-down-in-political-spending-fight/
Absent from Equity Talks: https://finance.yahoo.com/sectors/technology/articles/trump-ai-ownership-plan-could-131053732.html
Pliny Jaibreak: https://x.com/elder_plinius/status/2064776322979676227
Fusion: https://x.com/OpenRouter/status/2065856871215329545
https://lmcouncil.ai
Non-hype Newsletter: https://signaltonoise.beehiiv.com/
Podcast: https://aiexplainedopodcast.buzzsprout.com/
Learn more about your ad choices. Visit megaphone.fm/adchoices
Superintelligence when? This question is more urgent than ever as we hear competing timelines from Inflection AI, OpenAI and the leaders at the Center for AI Safety. This video not only covers the what was said, it offers some data on what superintelligence is projected to be capable of.
I discuss things that can hasten those timelines (see the new Netflix doc, Top 1% for Creativity and the AI Natural Selection paper) or slow it down (ft. Yuval Noah Hariri, the new Jailbroken paper, and more). And I end on some reflections of what it might mean to interact with a superintelligence (ft Douglas Hofstadter).
Introducing Superalignment: https://openai.com/blog/introducing-superalignment
Odds of Success: https://twitter.com/janleike/with_replies?ref_src=twsrc%5Egoogle%7Ctwcamp%5Eserp%7Ctwgr%5Eauthor
Mustafa Suleyman (Inflection AI) Interview: https://www.youtube.com/watch?v=oAxNkehgzEU
Inflection Supercomputer: https://www.tomshardware.com/news/startup-builds-supercomputer-with-22000-nvidias-h100-compute-gpus
GPT 2030: https://www.lesswrong.com/posts/WZXqNYbJhtidjRXSi/what-will-gpt-2030-look-like
Counterpoint: https://twitter.com/xuanalogue/status/1666765447054647297
Creativity Test: https://www.umt.edu/news/2023/07/070523test.php
MMLU: https://arxiv.org/pdf/2009.03300.pdf
Boston Globe CAI: https://www.bostonglobe.com/2023/07/06/opinion/ai-safety-human-extinction-dan-hendrycks-cais/
Yuval Noah Hariri Guardian: https://www.theguardian.com/technology/2023/jul/06/ai-firms-face-prison-creation-fake-humans-yuval-noah-harari
Jailbroken Paper: https://arxiv.org/pdf/2307.02483.pdf
Suleyman Hallucination Tweet: https://twitter.com/mustafasuleymn/status/1678072401760796672?ref_src=twsrc%5Egoogle%7Ctwcamp%5Eserp%7Ctwgr%5Etweet
Killer Robots: https://www.youtube.com/watch?v=YsSzNOpr9cE
Automated Apple-picking: https://twitter.com/AiBreakfast/status/1677828971214282752
50 year Mortgages: https://www.ft.com/content/281fbba6-28e2-42d4-b241-0f215995f0d1
Heypi: https://heypi.com/talk
Natural Selection Favors AIs over Humans: https://arxiv.org/pdf/2303.16200.pdf#:~:text=Natural%20selection%20may%20be%20a,designs%20to%20be%20selected%20naturally.
Gödel, Escher, Bach author Doug Hofstadter on the state of AI today: https://www.youtube.com/watch?v=lfXxzAVtdpU&t=1763s
https://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/
Learn more about your ad choices. Visit megaphone.fm/adchoices
Drawing upon 6 academic papers, interview snippets, possible leaks, and my own extensive research, I put together everything we might know about GPT 5: what will determine its IQ, its timeline and its impact on the job market and beyond.
Starting with an insider interview on the names of GPT models, such as GPT 4 and GPT 5, then looking into the clearest hint that GPT 4 is inside Bing. Next, I briefly cover reports of a leak about GPT 5 and discuss the scale of GPUs require to train it, touching on the upgrade form A100 to H100 GPUs.
Then the DeepMind paper that changed everything, focusing LLM research on data rather than parameter count. I go over a lesswrong post about that paper's 'wild implications'. And then the key paper: 'Will We Run Out of Data'. This encapsulates the key dynamic that will either propel or bottleneck GPT and other LLM improvements.
Next, I examine a different take, that perhaps data is already limited and caused the Sydney model of Bing. This opens up to a discussion on the data behind these models and why Big Tech is so unforthcoming about where it originates. Could a new legal war be brewing?
I then cover 4 of the ways these models may improve even without data augmentation, such as Automatic Chain of Thought, high quality data extraction, tool training, including Wolfram Alpha, retraining on existing data sets, artificial data generation and more.
We take a quick look at Sam Altman's timelines and host of Big Bench benchmarks that they may impact, such as reading comprehension, critical reasoning, logic, physics and Math. I address Altman's quote about timelines being delayed by alignment and safety and finally, Altman's comments on AGI and how they pertain to GPT 5.
https://www.patreon.com/AIExplained
https://stratechery.com/2023/new-bing-and-an-interview-with-kevin-scott-and-sam-altman-about-the-microsoft-openai-partnership/
https://twitter.com/XiXiDu/status/1285225627390443521
https://www.linkedin.com/pulse/building-new-bing-jordi-ribas/
https://twitter.com/davidtayar5/status/1625140481016340483/photo/1
https://www.techradar.com/news/chatgpt-might-bring-about-another-gpu-shortage-sooner-than-you-might-expect
https://www.nvidia.com/en-gb/data-center/h100/
https://arxiv.org/pdf/2203.15556.pdf
https://www.lesswrong.com/posts/6Fpvch8RR29qLEWNH/chinchilla-s-wild-implications
https://twitter.com/Meaningness/status/1628052277050376192
https://arxiv.org/pdf/2211.04325.pdf
https://twitter.com/Meaningness/status/1628052277050376192
https://www.searchenginejournal.com/google-bard-training-data/478941/#close
https://arxiv.org/pdf/2302.12822.pdf
https://arxiv.org/pdf/2302.04761.pdf
https://www.wolframalpha.com/
https://arxiv.org/pdf/2207.14502.pdf
https://aclanthology.org/2022.findings-emnlp.508.pdf
https://www.technologyreview.com/2022/11/24/1063684/we-could-run-out-of-data-to-train-ai-language-programs/
https://twitter.com/sama/status/1625980933861175306
https://github.com/google/BIG-bench/blob/main/bigbench/benchmark_tasks/results/plot_BIG-bench_lite_aggregate.png
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/gre_reading_comprehension
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/logical_args
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/physics
https://lifearchitect.ai/gpt-4/
https://www.lesswrong.com/posts/uxnjXBwr79uxLkifG/comments-on-openai-s-planning-for-agi-and-beyond
https://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/
Learn more about your ad choices. Visit megaphone.fm/adchoices
GPT-5 will change how hundreds of millions of people use AI. Yes, you might have to forgive the chart crimes, the underwhelming livestream and Altman hype… But it’s a good model. I have read the 50 page system card in full, have the benchmark scores, coding tests, and things you might have missed.
https://app.grayswan.ai/ai-explained
AI Insiders ($9!): https://www.patreon.com/AIExplained
Announcement: https://openai.com/index/introducing-gpt-5/
System Card: https://cdn.openai.com/pdf/8124a3ce-ab78-4f06-96eb-49ea29ffb52f/gpt5-system-card-aug7.pdf
Extra Paper: https://cdn.openai.com/pdf/be60c07b-6bc2-4f54-bcee-4141e1d6c69a/gpt-5-safe_completions.pdf
Altman tweet: https://x.com/sama/status/1953551377873117369
Livestream: https://www.youtube.com/watch?v=0Uu_VJeVVfo
METR Report: https://metr.github.io/autonomy-evals-guide/gpt-5-report/
ARC-AGI-2: https://x.com/fchollet/status/1953511631054680085
Claude Opus 4.1: https://www.anthropic.com/news/claude-opus-4-1
MMMU: https://mmmu-benchmark.github.io/
Cursor Praise: https://x.com/ryolu_/status/1953531724895596669
Non-hype Newsletter: https://signaltonoise.beehiiv.com/
Podcast: https://aiexplainedopodcast.buzzsprout.com/
Learn more about your ad choices. Visit megaphone.fm/adchoices
Hopefully the last in a trilogy of videos covering the saga at OpenAI. New revelations on the return of Sam Altman, internal investigations, Microsoft demands and employee revolts. Plus a major new model previewed from Inflection, Claude 2.1 and a major pancreatic cancer breakthrough with AI. More non-OpenAI news to come.
WSJ Exclusive: https://www.wsj.com/tech/ai/altman-firing-openai-520a3a8c
Altman Tweet: https://twitter.com/sama/status/1727207458324848883
Emily Chang: https://twitter.com/emilychangtv/status/1727228431396704557
OpenAI Charter: https://openai.com/our-structure
Geoffrey Irving Post: https://twitter.com/geoffreyirving/status/1726754270224023971
Nadella Interview: https://www.youtube.com/watch?v=Ut9zcpOEGgc&t=1s
Kevin Scott Outreach: https://twitter.com/kevin_scott/status/1726971608706031670?ref_src=twsrc%5Etfw%7Ctwcamp%5Etweetembed%7Ctwterm%5E1726971608706031670%7Ctwgr%5E8c6b9e371b7b294478b806bf3fd70002cc344785%7Ctwcon%5Es1_&ref_url=https%3A%2F%2Fwww.bbc.co.uk%2Fnews%2Ftechnology-67484455
NYT Exclusive: https://www.nytimes.com/2023/11/21/technology/openai-altman-board-fight.html
Toner Report: https://cset.georgetown.edu/publication/decoding-intentions/
Sam Altman Comments: https://www.youtube.com/watch?v=3sWH2e5xpdo&t=86s
Open Letter from OpenAI: https://s.wsj.net/public/resources/documents/OpenAIletter.pdf
Anthropic Merger: https://www.theinformation.com/articles/openai-approached-anthropic-about-merger?rc=sy0ihq
New Board: https://www.bloomberg.com/news/articles/2023-11-22/sam-altman-to-return-as-openai-ceo-with-a-new-board?srnd=premium-uk&embedded-checkout=true
Altman Blog: https://blog.samaltman.com/quora
Nadella Statements: https://twitter.com/codejake/status/1726794158424424511
https://twitter.com/satyanadella/status/1727207661547233721?ref_src=twsrc%5Etfw%7Ctwcamp%5Etweetembed%7Ctwterm%5E1727207661547233721%7Ctwgr%5Ef14cfdae2ac0873a85c1cc6cd2104444c9947991%7Ctwcon%5Es1_&ref_url=https%3A%2F%2Fwww.theverge.com%2F2023%2F11%2F22%2F23967223%2Fsam-altman-returns-ceo-open-ai
Larry Summers Interview: https://twitter.com/BloombergTV/status/1644388988071886848
Claude 2.1: https://www.anthropic.com/index/claude-2-1
https://twitter.com/GregKamradt/status/1727018183608193393/photo/1
Inflection 2: https://www.forbes.com/sites/alexkonrad/2023/11/22/inflection-ai-releases-2nd-model-on-gpt-4-heels/
Cancer Detection: https://www.nature.com/articles/s41591-023-02640-w#Abs1
https://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/
Learn more about your ad choices. Visit megaphone.fm/adchoices