Our 192nd episode with a summary and discussion of last week's* big AI news!
*and sometimes last last week's
Note: this one was recorded on 12/04 , so the news is a bit outdated...
Hosted by Andrey Kurenkov and Jeremie Harris.
Feel free to email us your questions and feedback at
[email protected] and/or
[email protected]Read out our text newsletter and comment on the podcast at https://lastweekin.ai/.
The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence.The AI safety book “Uncontrollable" which is not a doomer book, but instead lays out the reasonable case for AI safety and what we can do about it. Max TEGMARK said that “Uncontrollable” is a captivating, balanced, and remarkably up-to-date book on the most important issue of our time" - find it on Amazon today!OpenAI launches a $200 ChatGPT Pro subscription with advanced capabilities, while Amazon unveils cost-effective Nova multimodal models at the re:Invent conference.Meta releases LLAMA 3.3 70B model, showing significant gains through post-training techniques, and Alibaba introduces QWQ, a reasoning model rivaling OpenAI's O1.Amazon collaborates with Anthropic on a massive AI supercomputer project, and Black Forest Labs eyes a $200 million funding round for growth in AI tools.New research from DeepMind's Genie 2 generates interactive 3D worlds from text and images, progressing AI's understanding of world models and interactive environments.If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form.
(00:00:00) Intro / Banter(00:02:34) Sponsor BreakTools & Apps(00:04:19) OpenAI confirms new $200 monthly subscription, which includes its o1 reasoning model(00:10:40) Amazon announces Nova, a new family of multimodal AI models(00:17:13) ElevenLabs launches GenFM to turn user content into AI-powered podcasts(00:20:21) Google’s new generative AI video model is now availableApplications & Business(00:23:56) Elon Musk files for injunction to halt OpenAI’s transition to a for-profit(00:29:40) Amazon Is Building a Mega AI Supercomputer With Anthropic(00:34:15) It Sounds an Awful Lot Like OpenAI Is Adding Ads to ChatGPT(00:38:23) A16z in Talks to Lead $200 Million Round in Black Forest Labs, Startup Behind AI Images on Grok(00:41:10) Bezos Backs AI Chipmaker Vying With Nvidia at $2.6 Billion ValueProjects & Open Source(00:45:25) Meta unveils a new, more efficient Llama model(00:50:00) Alibaba releases an ‘open’ challenger to OpenAI’s o1 reasoning model(00:55:21) DeMo: Decoupled Momentum Optimization(00:57:01) PRIME Intellect Releases INTELLECT-1 (Instruct + Base): The First 10B Parameter Language Model Collaboratively Trained Across the Globe(01:03:03) Tencent Launches HunyuanVideo, an Open-Source AI Video ModelResearch & Advancements(01:09:23) DeepMind’s Genie 2 can generate interactive worlds that look like video games(01:16:43) Language Models are Hidden Reasoners: Unlocking Latent Reasoning Capabilities via Self-Rewarding(01:20:40) Densing Law of LLMs(01:25:59) Monet: Mixture of Monosemantic Experts for TransformersPolicy & Safety(01:30:56) Commerce Strengthens Export Controls to Restrict China’s Capability to Produce Advanced Semiconductors for Military Applications(01:37:33) China retaliates against latest US chip restrictions(01:40:52) OpenAI Is Working With Anduril to Supply the US Military With AI(01:43:24) On Targeted Manipulation and Deception when Optimizing LLMs for User Feedback(01:47:52) AI Safety Researcher Quits OpenAI, Saying Its Trajectory Alarms Her(01:51:52) Meta Claims AI Content Was Less than 1% of Election Misinformation(01:55:05) Outro