Sign up to save your podcasts
Or
Share Abstracts: NeurIPS 2024 with Weizhu Chen
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Abstracts: NeurIPS 2024 with Weizhu Chen
Next-token prediction trains a language model on all tokens in a sequence. VP Weizhu Chen discusses his team’s 2024 NeurIPS paper on how distinguishing between useful and “noisy” tokens in pretraining can improve token efficiency and model performance.
Read the paper
Get the code
View all episodes
By Researchers across the Microsoft research community
4.8
8080 ratings
Next-token prediction trains a language model on all tokens in a sequence. VP Weizhu Chen discusses his team’s 2024 NeurIPS paper on how distinguishing between useful and “noisy” tokens in pretraining can improve token efficiency and model performance.
Read the paper
Get the code
More shows like Microsoft Research Podcast
View all
a16z Podcast
1,040 Listeners
Data Skeptic
481 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
441 Listeners
Super Data Science: ML & AI Podcast with Jon Krohn
298 Listeners
NVIDIA AI Podcast
331 Listeners
The Future of Everything
127 Listeners
AI Today Podcast
156 Listeners
Practical AI
192 Listeners
Google DeepMind: The Podcast
198 Listeners
Machine Learning Street Talk (MLST)
88 Listeners
Big Technology Podcast
454 Listeners
MIT Technology Review Narrated
259 Listeners
WorkLab
61 Listeners
Latent Space: The AI Engineer Podcast
75 Listeners
The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis
491 Listeners