Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [QA] Not All Rollouts are Useful: Down-Sampling Rollouts in LLM Reinforcement Learning
PODS decouples reinforcement learning phases by parallelizing rollouts and selectively updating, using max-variance down-sampling to enhance performance on the GSM8K benchmark compared to standard GRPO.
https://arxiv.org/abs//2504.13818
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Not All Rollouts are Useful: Down-Sampling Rollouts in LLM Reinforcement Learning
PODS decouples reinforcement learning phases by parallelizing rollouts and selectively updating, using max-variance down-sampling to enhance performance on the GSM8K benchmark compared to standard GRPO.
https://arxiv.org/abs//2504.13818
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - [QA] Let Me Grok for You: Accelerating Grokking via Embedding Transfer from a Weaker Model
The paper presents a method to accelerate "grokking" in neural networks by using learned embeddings from a weaker model, enabling direct generalization without delay across various tasks.
https://arxiv.org/abs//2504.13292
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Let Me Grok for You: Accelerating Grokking via Embedding Transfer from a Weaker Model
The paper presents a method to accelerate "grokking" in neural networks by using learned embeddings from a weaker model, enabling direct generalization without delay across various tasks.
https://arxiv.org/abs//2504.13292
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
17 min - [QA] Reasoning Models Can Be Effective Without Thinking
This paper challenges the necessity of lengthy reasoning processes in LLMs, showing that simple prompting (NoThinking) can outperform traditional methods in various reasoning tasks, especially in low-budget scenarios.
https://arxiv.org/abs//2504.09858
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Reasoning Models Can Be Effective Without Thinking
This paper challenges the necessity of lengthy reasoning processes in LLMs, showing that simple prompting (NoThinking) can outperform traditional methods in various reasoning tasks, especially in low-budget scenarios.
https://arxiv.org/abs//2504.09858
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
21 min - [QA] A Minimalist Approach to LLM Reasoning: from Rejection Sampling to Reinforce
This paper analyzes GRPO in reinforcement learning for language models, revealing that a simple rejection sampling method, RAFT, performs competitively and suggesting improvements for future reward-based training approaches.
https://arxiv.org/abs//2504.11343
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - A Minimalist Approach to LLM Reasoning: from Rejection Sampling to Reinforce
This paper analyzes GRPO in reinforcement learning for language models, revealing that a simple rejection sampling method, RAFT, performs competitively and suggesting improvements for future reward-based training approaches.
https://arxiv.org/abs//2504.11343
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
15 min - [QA] CLIMB: CLustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-training
https://arxiv.org/abs//2504.13161
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - CLIMB: CLustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-training
https://arxiv.org/abs//2504.13161
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
21 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,964 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
438 Listeners
The Daily
111,734 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,100 Listeners
Hard Fork
5,569 Listeners
UnHerd with Freddie Sayers
217 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
102 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners