Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [short] A Tale of Tails: Model Collapse as a Change of Scaling Laws
The paper explores how neural scaling laws may change as synthetic data is incorporated into training, potentially leading to model collapse.
https://arxiv.org/abs//2402.07043
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - A Tale of Tails: Model Collapse as a Change of Scaling Laws
The paper explores how neural scaling laws may change as synthetic data is incorporated into training, potentially leading to model collapse.
https://arxiv.org/abs//2402.07043
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
25 min - [short] Scaling Laws for Fine-Grained Mixture of Experts
Analysis of Mixture of Experts (MoE) models' scaling properties introduces a new hyperparameter, granularity, optimizing training configuration for computational efficiency over dense Transformers.
https://arxiv.org/abs//2402.07871
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - Scaling Laws for Fine-Grained Mixture of Experts
Analysis of Mixture of Experts (MoE) models' scaling properties introduces a new hyperparameter, granularity, optimizing training configuration for computational efficiency over dense Transformers.
https://arxiv.org/abs//2402.07871
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
20 min - [short] Suppressing Pink Elephants with Direct Principle Feedback
The paper introduces Direct Principle Feedback for controlling language models at inference time, showcasing improved performance on the Pink Elephant Problem compared to existing methods.
https://arxiv.org/abs//2402.07896
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - Suppressing Pink Elephants with Direct Principle Feedback
The paper introduces Direct Principle Feedback for controlling language models at inference time, showcasing improved performance on the Pink Elephant Problem compared to existing methods.
https://arxiv.org/abs//2402.07896
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
17 min - V-STaR: Training Verifiers for Self-Taught Reasoners
V-STaR leverages correct and incorrect solutions from self-improvement of large language models to train a verifier, improving problem-solving accuracy by 4%-17% on various benchmarks.
https://arxiv.org/abs//2402.06457
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - V-STaR: Training Verifiers for Self-Taught Reasoners
V-STaR leverages correct and incorrect solutions from self-improvement of large language models to train a verifier, improving problem-solving accuracy by 4%-17% on various benchmarks.
https://arxiv.org/abs//2402.06457
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
21 min - [short] Feedback Loops With Language Models Drive In-Context Reward Hacking
Language models interact with the world through APIs, content generation, and system commands, creating feedback loops that can lead to in-context reward hacking. Recommendations for evaluation are provided.
https://arxiv.org/abs//2402.06627
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - Feedback Loops With Language Models Drive In-Context Reward Hacking
Language models interact with the world through APIs, content generation, and system commands, creating feedback loops that can lead to in-context reward hacking. Recommendations for evaluation are provided.
https://arxiv.org/abs//2402.06627
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
21 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,967 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,764 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,107 Listeners
Hard Fork
5,561 Listeners
UnHerd with Freddie Sayers
216 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
102 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners