Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [QA] Does your data spark joy? Performance gains from domain upsampling at the end of training
Leveraging domain-specific datasets through upsampling at the end of training improves model performance on benchmarks, offering a cost-effective alternative to full pretraining runs.
https://arxiv.org/abs//2406.03476
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Does your data spark joy? Performance gains from domain upsampling at the end of training
Leveraging domain-specific datasets through upsampling at the end of training improves model performance on benchmarks, offering a cost-effective alternative to full pretraining runs.
https://arxiv.org/abs//2406.03476
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - [QA] Guiding a Diffusion Model with a Bad Version of Itself
Guiding image generation with a smaller model instead of an unconditional one improves image quality without sacrificing variation, achieving record FIDs in ImageNet generation.
https://arxiv.org/abs//2406.02507
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Guiding a Diffusion Model with a Bad Version of Itself
Guiding image generation with a smaller model instead of an unconditional one improves image quality without sacrificing variation, achieving record FIDs in ImageNet generation.
https://arxiv.org/abs//2406.02507
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
17 min - [QA] To Believe or Not to Believe Your LLM
The paper explores quantifying uncertainty in large language models to detect unreliable responses, focusing on distinguishing epistemic and aleatoric uncertainties using an information-theoretic metric.
https://arxiv.org/abs//2406.02543
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
11 min - To Believe or Not to Believe Your LLM
The paper explores quantifying uncertainty in large language models to detect unreliable responses, focusing on distinguishing epistemic and aleatoric uncertainties using an information-theoretic metric.
https://arxiv.org/abs//2406.02543
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
15 min - [QA] Learning to grok: Emergence of in-context learning and skill composition in modular arithmetic tasks
Study explores in-context learning and skill composition in modular arithmetic tasks using GPT-style transformer models, showing transition from in-distribution to out-of-distribution generalization with increasing pre-training tasks.
https://arxiv.org/abs//2406.02550
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
10 min - Learning to grok: Emergence of in-context learning and skill composition in modular arithmetic tasks
Study explores in-context learning and skill composition in modular arithmetic tasks using GPT-style transformer models, showing transition from in-distribution to out-of-distribution generalization with increasing pre-training tasks.
https://arxiv.org/abs//2406.02550
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
19 min - [QA] Show, Don't Tell: Aligning Language Models with Demonstrated Feedback
Demonstration ITerated Task Optimization (DITTO) aligns language models to specific settings using a few demonstrations, outperforming other methods by 19% on average.
https://arxiv.org/abs//2406.00888
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Show, Don't Tell: Aligning Language Models with Demonstrated Feedback
Demonstration ITerated Task Optimization (DITTO) aligns language models to specific settings using a few demonstrations, outperforming other methods by 19% on average.
https://arxiv.org/abs//2406.00888
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
21 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,960 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,708 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,107 Listeners
Hard Fork
5,564 Listeners
UnHerd with Freddie Sayers
216 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
101 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners