Last Week in AI

#175 - GPT-4o Mini, OpenAI's Strawberry, Mixture of A Million Experts


Listen Later

Our 175th episode with a summary and discussion of last week's big AI news!

With hosts Andrey Kurenkov (https://twitter.com/andrey_kurenkov) and Jeremie Harris (https://twitter.com/jeremiecharris)

In this episode of Last Week in AI, hosts Andrey Kurenkov and Jeremy Harris explore recent AI advancements including OpenAI's release of GPT 4.0 Mini and Mistral’s open-source models, covering their impacts on affordability and performance. They delve into enterprise tools for compliance, text-to-video models like Hyper 1.5, and YouTube Music enhancements. The conversation further addresses AI research topics such as the benefits of numerous small expert models, novel benchmarking techniques, and advanced AI reasoning. Policy issues including U.S. export controls on AI technology to China and internal controversies at OpenAI are also discussed, alongside Elon Musk's supercomputer ambitions and OpenAI’s Prover-Verify Games initiative.
 

Read out our text newsletter and comment on the podcast at https://lastweekin.ai/

If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form.

Email us your questions and feedback at [email protected] and/or [email protected]

 

Timestamps + links:

  • (00:00:00) AI Song Intro
  • (00:00:40) Intro / Banter
  • Tools & Apps
    • (00:03:57) OpenAI unveils GPT-4o mini, a small AI model powering ChatGPT
  • (00:11:38) Meet Haiper 1.5, the new AI video generation model challenging Sora, Runway
  • (00:16:32) Anthropic releases Claude app for Android
  • (00:18:59) Google Vids is available to test out Gemini AI-created video presentations
  • (00:20:27) YouTube Music sound search rolling out, AI ‘conversational radio’ in testing 
  • Applications & Business
    • (00:23:30) OpenAI working on new reasoning technology under code name ‘Strawberry’
  • (00:30:45) Inside Elon Musk’s Mad Dash To Build A Giant xAI Supercomputer In Memphis
  • (00:37:15) Apple, NVIDIA and Anthropic reportedly used YouTube transcripts without permission to train AI models
  • (00:41:05) After Tesla and OpenAI, Andrej Karpathy’s startup aims to apply AI assistants to education
  • (00:43:40) Menlo Ventures and Anthropic team up on a $100M AI fund
  • Projects & Open Source
    • (00:46:27) Mistral releases Codestral Mamba for faster, longer code generation
  • (00:50:36) Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model
  • (00:52:51) Hugging Face Releases SmoLLM, a Series of Small Language Models, Beats Qwen2 and Phi 1.5
  • (00:56:11) Stable Diffusion 3 License Revamped Amid Blowback, Promising Better Model
  • Research & Advancements
    • (01:01:49) FlashAttention-3 unleashes the power of H100 GPUs for LLMs
  • (01:06:38) Mixture of A Million Experts
  • (01:12:51) AutoBencher: Creating Salient, Novel, Difficult Datasets for Language Models
  • (01:18:23) SpreadsheetLLM: Encoding Spreadsheets for Large Language >Models
  • Policy & Safety
    • (01:20:50) Prover-Verifier Games improve legibility of language model outputs
  • (01:28:05) Trump allies draft AI order to launch ‘Manhattan Projects’ for defense
  • (01:34:40) On scalable oversight with weak LLMs judging strong LLMs
  • (01:36:24) Google, Microsoft offer Nvidia chips to Chinese companies, the Information reports
  • (01:38:26) U.S. planning 'draconian' sanctions against China's semiconductor industry: Report
  • (01:48:47) OpenAI illegally barred staff from airing safety risks, whistleblowers say
  • (01:44:59) Outro + AI Song
  • ...more
    View all episodesView all episodes
    Download on the App Store

    Last Week in AIBy Skynet Today

    • 4.7
    • 4.7
    • 4.7
    • 4.7
    • 4.7

    4.7

    273 ratings


    More shows like Last Week in AI

    View all
    The AI in Business Podcast by Daniel Faggella

    The AI in Business Podcast

    164 Listeners

    Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

    Super Data Science: ML & AI Podcast with Jon Krohn

    296 Listeners

    NVIDIA AI Podcast by NVIDIA

    NVIDIA AI Podcast

    326 Listeners

    AI Today Podcast by AI & Data Today

    AI Today Podcast

    146 Listeners

    Practical AI by Practical AI LLC

    Practical AI

    190 Listeners

    Me, Myself, and AI by MIT Sloan Management Review and Boston Consulting Group (BCG)

    Me, Myself, and AI

    101 Listeners

    AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning by Jaeden Schafer

    AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning

    145 Listeners

    AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI by Jaeden Schafer and Jamie McCauley

    AI Hustle: Make Money from AI and ChatGPT, Midjourney, NVIDIA, Anthropic, OpenAI

    64 Listeners

    This Day in AI Podcast by Michael Sharkey, Chris Sharkey

    This Day in AI Podcast

    196 Listeners

    Latent Space: The AI Engineer Podcast by swyx + Alessio

    Latent Space: The AI Engineer Podcast

    75 Listeners

    The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

    The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

    440 Listeners

    AI For Humans: Making Artificial Intelligence Fun & Practical by Kevin Pereira & Gavin Purcell

    AI For Humans: Making Artificial Intelligence Fun & Practical

    235 Listeners

    Everyday AI Podcast – An AI and ChatGPT Podcast by Everyday AI

    Everyday AI Podcast – An AI and ChatGPT Podcast

    86 Listeners

    A Beginner's Guide to AI by Dietmar Fischer

    A Beginner's Guide to AI

    30 Listeners

    The TED AI Show by TED

    The TED AI Show

    47 Listeners