Gradient Dissent: Conversations on AI

Clément Delangue — The Power of the Open Source Community


Listen Later

Clem explains the virtuous cycles behind the creation and success of Hugging Face, and shares his thoughts on where NLP is heading.
---
Clément Delangue is co-founder and CEO of Hugging Face, the AI community building the future. Hugging Face started as an open source NLP library and has quickly grown into a commercial product used by over 5,000 companies.
Connect with Clem:
📍 Twitter: https://twitter.com/ClementDelangue
📍 LinkedIn: https://www.linkedin.com/in/clementdelangue/
---
🌟 Transcript: http://wandb.me/gd-clement-delangue 🌟
⏳ Timestamps:
0:00 Sneak peek and intro
0:56 What is Hugging Face?
4:15 The success of Hugging Face Transformers
7:53 Open source and virtuous cycles
10:37 Working with both TensorFlow and PyTorch
13:20 The "Write With Transformer" project
14:36 Transfer learning in NLP
16:43 BERT and DistilBERT
22:33 GPT
26:32 The power of the open source community
29:40 Current applications of NLP
35:15 The Turing Test and conversational AI
41:19 Why speech is an upcoming field within NLP
43:44 The human challenges of machine learning
Links Discussed:
📍 Write With Transformer, Hugging Face Transformer's text generation demo: https://transformer.huggingface.co/
📍 "Attention Is All You Need" (Vaswani et al., 2017): https://arxiv.org/abs/1706.03762
📍 EleutherAI and GPT-Neo: https://github.com/EleutherAI/gpt-neo]
📍 Rasa, open source conversational AI: https://rasa.com/
📍 Roblox article on BERT: https://blog.roblox.com/2020/05/scaled-bert-serve-1-billion-daily-requests-cpus/
---
Get our podcast on these platforms:
👉 Apple Podcasts: http://wandb.me/apple-podcasts​​
👉 Spotify: http://wandb.me/spotify​
👉 Google Podcasts: http://wandb.me/google-podcasts​​
👉 YouTube: http://wandb.me/youtube​​
👉 Soundcloud: http://wandb.me/soundcloud​
Join our community of ML practitioners where we host AMAs, share interesting projects and meet other people working in Deep Learning:
http://wandb.me/slack​​
Check out Fully Connected, which features curated machine learning reports by researchers exploring deep learning techniques, Kagglers showcasing winning models, industry leaders sharing best practices, and more:
https://wandb.ai/fully-connected
...more
View all episodesView all episodes
Download on the App Store

Gradient Dissent: Conversations on AIBy Lukas Biewald

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

68 ratings


More shows like Gradient Dissent: Conversations on AI

View all
The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

537 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,089 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

302 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

334 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

226 Listeners

Practical AI by Practical AI LLC

Practical AI

211 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

95 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

511 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

131 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

227 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

610 Listeners

AI and I by Dan Shipper

AI and I

33 Listeners

AI + a16z by a16z

AI + a16z

35 Listeners

Lightcone Podcast by Y Combinator

Lightcone Podcast

21 Listeners

Training Data by Sequoia Capital

Training Data

40 Listeners