Gradient Dissent: Conversations on AI

Clément Delangue — The Power of the Open Source Community


Listen Later

Clem explains the virtuous cycles behind the creation and success of Hugging Face, and shares his thoughts on where NLP is heading.
---
Clément Delangue is co-founder and CEO of Hugging Face, the AI community building the future. Hugging Face started as an open source NLP library and has quickly grown into a commercial product used by over 5,000 companies.
Connect with Clem:
📍 Twitter: https://twitter.com/ClementDelangue
📍 LinkedIn: https://www.linkedin.com/in/clementdelangue/
---
🌟 Transcript: http://wandb.me/gd-clement-delangue 🌟
⏳ Timestamps:
0:00 Sneak peek and intro
0:56 What is Hugging Face?
4:15 The success of Hugging Face Transformers
7:53 Open source and virtuous cycles
10:37 Working with both TensorFlow and PyTorch
13:20 The "Write With Transformer" project
14:36 Transfer learning in NLP
16:43 BERT and DistilBERT
22:33 GPT
26:32 The power of the open source community
29:40 Current applications of NLP
35:15 The Turing Test and conversational AI
41:19 Why speech is an upcoming field within NLP
43:44 The human challenges of machine learning
Links Discussed:
📍 Write With Transformer, Hugging Face Transformer's text generation demo: https://transformer.huggingface.co/
📍 "Attention Is All You Need" (Vaswani et al., 2017): https://arxiv.org/abs/1706.03762
📍 EleutherAI and GPT-Neo: https://github.com/EleutherAI/gpt-neo]
📍 Rasa, open source conversational AI: https://rasa.com/
📍 Roblox article on BERT: https://blog.roblox.com/2020/05/scaled-bert-serve-1-billion-daily-requests-cpus/
---
Get our podcast on these platforms:
👉 Apple Podcasts: http://wandb.me/apple-podcasts​​
👉 Spotify: http://wandb.me/spotify​
👉 Google Podcasts: http://wandb.me/google-podcasts​​
👉 YouTube: http://wandb.me/youtube​​
👉 Soundcloud: http://wandb.me/soundcloud​
Join our community of ML practitioners where we host AMAs, share interesting projects and meet other people working in Deep Learning:
http://wandb.me/slack​​
Check out Fully Connected, which features curated machine learning reports by researchers exploring deep learning techniques, Kagglers showcasing winning models, industry leaders sharing best practices, and more:
https://wandb.ai/fully-connected
...more
View all episodesView all episodes
Download on the App Store

Gradient Dissent: Conversations on AIBy Lukas Biewald

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

66 ratings


More shows like Gradient Dissent: Conversations on AI

View all
a16z Podcast by Andreessen Horowitz

a16z Podcast

998 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

441 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

295 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

324 Listeners

Practical AI by Practical AI LLC

Practical AI

189 Listeners

Google DeepMind: The Podcast by Hannah Fry

Google DeepMind: The Podcast

203 Listeners

Last Week in AI by Skynet Today

Last Week in AI

281 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

89 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

356 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

125 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

196 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

64 Listeners

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

420 Listeners

AI + a16z by a16z

AI + a16z

32 Listeners

Training Data by Sequoia Capital

Training Data

37 Listeners