Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [QA] LoRA Learns Less and Forgets Less
LoRA is a parameter-efficient finetuning method for large language models, but underperforms full finetuning in most cases. It offers strong regularization and diverse generations.
https://arxiv.org/abs//2405.09673
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - LoRA Learns Less and Forgets Less
LoRA is a parameter-efficient finetuning method for large language models, but underperforms full finetuning in most cases. It offers strong regularization and diverse generations.
https://arxiv.org/abs//2405.09673
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
14 min - [QA] The Platonic Representation Hypothesis
The paper argues that representations in AI models, especially deep networks, are converging towards a shared statistical model of reality, termed the platonic representation.
https://arxiv.org/abs//2405.07987
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - The Platonic Representation Hypothesis
The paper argues that representations in AI models, especially deep networks, are converging towards a shared statistical model of reality, termed the platonic representation.
https://arxiv.org/abs//2405.07987
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
18 min - [QA] Improving Transformers using Faithful Positional Encoding
New positional encoding method for Transformers improves time-series classification by preserving positional order information without loss, based on rigorous mathematics.
https://arxiv.org/abs//2405.09061
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Improving Transformers using Faithful Positional Encoding
New positional encoding method for Transformers improves time-series classification by preserving positional order information without loss, based on rigorous mathematics.
https://arxiv.org/abs//2405.09061
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
10 min - [QA] Beyond Scaling Laws: Understanding Transformer Performance with Associative Memory
Increasing Transformer model size doesn't always improve performance. A theoretical framework using associative memories and Hopfield networks explains memorization and performance dynamics in transformer-based language models.
https://arxiv.org/abs//2405.08707
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Beyond Scaling Laws: Understanding Transformer Performance with Associative Memory
Increasing Transformer model size doesn't always improve performance. A theoretical framework using associative memories and Hopfield networks explains memorization and performance dynamics in transformer-based language models.
https://arxiv.org/abs//2405.08707
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
14 min - [QA] Energy-based Hopfield Boosting for Out-of-Distribution Detection
Hopfield Boosting method enhances OOD detection by leveraging modern Hopfield energy, achieving state-of-the-art results with outlier exposure, significantly improving FPR95 metric on CIFAR-10 and CIFAR-100 datasets.
https://arxiv.org/abs//2405.08766
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Energy-based Hopfield Boosting for Out-of-Distribution Detection
Hopfield Boosting method enhances OOD detection by leveraging modern Hopfield energy, achieving state-of-the-art results with outlier exposure, significantly improving FPR95 metric on CIFAR-10 and CIFAR-100 datasets.
https://arxiv.org/abs//2405.08766
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
17 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,960 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,708 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,107 Listeners
Hard Fork
5,564 Listeners
UnHerd with Freddie Sayers
216 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
101 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners