Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [QA] Reinforcement Pre-Training
Reinforcement Pre-Training (RPT) enhances language models by using reinforcement learning for next-token prediction, improving accuracy and providing a strong foundation for further fine-tuning.
https://arxiv.org/abs//2506.08007
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Reinforcement Pre-Training
Reinforcement Pre-Training (RPT) enhances language models by using reinforcement learning for next-token prediction, improving accuracy and providing a strong foundation for further fine-tuning.
https://arxiv.org/abs//2506.08007
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
12 min - [QA] Corrector Sampling in Language Models
https://arxiv.org/abs//2506.06215
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Corrector Sampling in Language Models
https://arxiv.org/abs//2506.06215
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
20 min - [QA] Distillation Robustifies Unlearning
The paper presents UNDO, a method that enhances unlearning in LLMs through distillation, achieving robust capability removal with reduced compute and data requirements compared to traditional retraining methods.
https://arxiv.org/abs//2506.06278
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Distillation Robustifies Unlearning
The paper presents UNDO, a method that enhances unlearning in LLMs through distillation, achieving robust capability removal with reduced compute and data requirements compared to traditional retraining methods.
https://arxiv.org/abs//2506.06278
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
15 min - [QA] Log-Linear Attention
This paper introduces log-linear attention, enhancing linear attention's efficiency by using a logarithmically growing set of hidden states, improving sequence modeling while maintaining computational efficiency.
https://arxiv.org/abs//2506.04761
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Log-Linear Attention
This paper introduces log-linear attention, enhancing linear attention's efficiency by using a logarithmically growing set of hidden states, improving sequence modeling while maintaining computational efficiency.
https://arxiv.org/abs//2506.04761
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
22 min - [QA] Rewarding the Unlikely: Lifting GRPO Beyond Distribution Sharpening
This paper critiques GRPO's bias in training language models for theorem proving and introduces the unlikeliness reward to enhance performance and sample diversity, achieving competitive results.
https://arxiv.org/abs//2506.02355
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Rewarding the Unlikely: Lifting GRPO Beyond Distribution Sharpening
This paper critiques GRPO's bias in training language models for theorem proving and introduces the unlikeliness reward to enhance performance and sample diversity, achieving competitive results.
https://arxiv.org/abs//2506.02355
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
17 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,964 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
438 Listeners
The Daily
111,734 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,100 Listeners
Hard Fork
5,569 Listeners
UnHerd with Freddie Sayers
217 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
102 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners