Mixture of Experts

Episode 40: DeepSeek facts vs hype, model distillation, and open source competition


Listen Later

Let’s bust some early myths about DeepSeek. In episode 40 of Mixture of Experts, join host Tim Hwang along with experts Aaron Baughman, Chris Hay and Kate Soule. Last week, we covered the release of DeepSeek-R1; now that the entire world is up to speed, let’s separate the facts from the hype. Next, what is model distillation and why does it matter for competition in AI? Finally, Sam Altman among other tech CEOs shared his response to DeepSeek. Will R1 radically change the open-source strategy of other tech giants? Find out all this and more on Mixture of Experts.


00:01 – Intro

00:41 – DeepSeek facts vs hype

21:00 – Model distillation

31:21 – Open source and OpenAI


The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.


...more
View all episodesView all episodes
Download on the App Store

Mixture of ExpertsBy IBM

  • 5
  • 5
  • 5
  • 5
  • 5

5

11 ratings


More shows like Mixture of Experts

View all
The a16z Show by Andreessen Horowitz

The a16z Show

1,092 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

302 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

332 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

228 Listeners

Tech Brew Ride Home by Morning Brew

Tech Brew Ride Home

961 Listeners

Practical AI by Practical AI LLC

Practical AI

205 Listeners

Google DeepMind: The Podcast by Hannah Fry

Google DeepMind: The Podcast

205 Listeners

Last Week in AI by Skynet Today

Last Week in AI

306 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

515 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

500 Listeners

Hard Fork by The New York Times

Hard Fork

5,509 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

131 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

622 Listeners

AI + a16z by a16z

AI + a16z

36 Listeners

OpenAI Podcast by OpenAI

OpenAI Podcast

52 Listeners