Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [QA] Why is SAM Robust to Label Noise?
Sharpness-Aware Minimization (SAM) excels in label noise robustness, with peak performance under early stopping, attributed to changes in logit term and network Jacobian. Alternative methods mimic SAM's regularization effects effectively.
https://arxiv.org/abs//2405.03676
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
10 min - Why is SAM Robust to Label Noise?
Sharpness-Aware Minimization (SAM) excels in label noise robustness, with peak performance under early stopping, attributed to changes in logit term and network Jacobian. Alternative methods mimic SAM's regularization effects effectively.
https://arxiv.org/abs//2405.03676
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
17 min - [QA] Is Flash Attention Stable?
The paper addresses challenges in training large-scale machine learning models, focusing on numeric deviation causing instability, with a case study on Flash Attention optimization.
https://arxiv.org/abs//2405.02803
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
10 min - Is Flash Attention Stable?
The paper addresses challenges in training large-scale machine learning models, focusing on numeric deviation causing instability, with a case study on Flash Attention optimization.
https://arxiv.org/abs//2405.02803
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
11 min - [QA] Understanding LLMs Requires More Than Statistical Generalization
The paper discusses the non-identifiability of large language models (LLMs) and its implications on generalization, highlighting the need for a new theoretical perspective.
https://arxiv.org/abs//2405.01964
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
11 min - Understanding LLMs Requires More Than Statistical Generalization
The paper discusses the non-identifiability of large language models (LLMs) and its implications on generalization, highlighting the need for a new theoretical perspective.
https://arxiv.org/abs//2405.01964
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
20 min - [QA] Mitigating LLM Hallucinations via Conformal Abstention
Developing a method for large language models to abstain from providing incorrect answers, using self-consistency and conformal prediction to reduce hallucination rates.
https://arxiv.org/abs//2405.01563
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Mitigating LLM Hallucinations via Conformal Abstention
Developing a method for large language models to abstain from providing incorrect answers, using self-consistency and conformal prediction to reduce hallucination rates.
https://arxiv.org/abs//2405.01563
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
20 min - [QA] Structural Pruning of Pre-trained Language Models via Neural Architecture Search
Paper explores using neural architecture search (NAS) for structural pruning of pre-trained language models to optimize efficiency and generalization performance, utilizing two-stage weight-sharing NAS for accelerated search.
https://arxiv.org/abs//2405.02267
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Structural Pruning of Pre-trained Language Models via Neural Architecture Search
Paper explores using neural architecture search (NAS) for structural pruning of pre-trained language models to optimize efficiency and generalization performance, utilizing two-stage weight-sharing NAS for accelerated search.
https://arxiv.org/abs//2405.02267
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
14 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,960 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,708 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,107 Listeners
Hard Fork
5,564 Listeners
UnHerd with Freddie Sayers
216 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
101 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners