Mixture of Experts

Episode 40: DeepSeek facts vs hype, model distillation, and open source competition


Listen Later

Let’s bust some early myths about DeepSeek. In episode 40 of Mixture of Experts, join host Tim Hwang along with experts Aaron Baughman, Chris Hay and Kate Soule. Last week, we covered the release of DeepSeek-R1; now that the entire world is up to speed, let’s separate the facts from the hype. Next, what is model distillation and why does it matter for competition in AI? Finally, Sam Altman among other tech CEOs shared his response to DeepSeek. Will R1 radically change the open-source strategy of other tech giants? Find out all this and more on Mixture of Experts.


00:01 – Intro

00:41 – DeepSeek facts vs hype

21:00 – Model distillation

31:21 – Open source and OpenAI


The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.


...more
View all episodesView all episodes
Download on the App Store

Mixture of ExpertsBy IBM

  • 5
  • 5
  • 5
  • 5
  • 5

5

10 ratings


More shows like Mixture of Experts

View all
This Week in Startups by Jason Calacanis

This Week in Startups

1,279 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,079 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

296 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

339 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

222 Listeners

Practical AI by Practical AI LLC

Practical AI

208 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

469 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

129 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

209 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

96 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

552 Listeners

AI For Humans: Making Artificial Intelligence Fun & Practical by Kevin Pereira & Gavin Purcell

AI For Humans: Making Artificial Intelligence Fun & Practical

265 Listeners

AI + a16z by a16z

AI + a16z

32 Listeners

Training Data by Sequoia Capital

Training Data

40 Listeners

OpenAI Podcast by OpenAI

OpenAI Podcast

54 Listeners