Sign up to save your podcasts
Or
Share Abstracts: NeurIPS 2024 with Weizhu Chen
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Abstracts: NeurIPS 2024 with Weizhu Chen
Next-token prediction trains a language model on all tokens in a sequence. VP Weizhu Chen discusses his team’s 2024 NeurIPS paper on how distinguishing between useful and “noisy” tokens in pretraining can improve token efficiency and model performance.
Read the paper
Get the code
View all episodes
By Researchers across the Microsoft research community
4.8
8080 ratings
Next-token prediction trains a language model on all tokens in a sequence. VP Weizhu Chen discusses his team’s 2024 NeurIPS paper on how distinguishing between useful and “noisy” tokens in pretraining can improve token efficiency and model performance.
Read the paper
Get the code
More shows like Microsoft Research Podcast
View all
Data Engineering Podcast
145 Listeners
The Daily
112,952 Listeners
Practical AI
200 Listeners
Google DeepMind: The Podcast
201 Listeners
Think Fast Talk Smart: Communication Techniques
821 Listeners
Last Week in AI
309 Listeners
Big Technology Podcast
507 Listeners
The Rest Is History
15,823 Listeners
No Priors: Artificial Intelligence | Technology | Startups
140 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
99 Listeners