Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [short] SEQUOIA: Scalable, Robust, and Hardware-aware Speculative Decoding
SEQUOIA is a scalable, robust, and hardware-aware algorithm for speculative decoding, improving inference speed for large language models on various hardware platforms.
https://arxiv.org/abs//2402.12374
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - SEQUOIA: Scalable, Robust, and Hardware-aware Speculative Decoding
SEQUOIA is a scalable, robust, and hardware-aware algorithm for speculative decoding, improving inference speed for large language models on various hardware platforms.
https://arxiv.org/abs//2402.12374
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
30 min - [short] Reformatted Alignment
REALIGN improves large language models' alignment with human values by reformatting instruction data responses, enhancing math reasoning, factuality, and readability without additional data or training techniques.
https://arxiv.org/abs//2402.12219
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - Reformatted Alignment
REALIGN improves large language models' alignment with human values by reformatting instruction data responses, enhancing math reasoning, factuality, and readability without additional data or training techniques.
https://arxiv.org/abs//2402.12219
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
22 min - [short] PaLM2-VAdapter: Progressively Aligned Language Model Makes a Strong Vision-language Adapter
The paper introduces PaLM2-VAdapter, a progressively aligned language model as a vision-language adapter, showing faster convergence, higher performance, and stronger scalability in multi-modal tasks with fewer parameters.
https://arxiv.org/abs//2402.10896
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - PaLM2-VAdapter: Progressively Aligned Language Model Makes a Strong Vision-language Adapter
The paper introduces PaLM2-VAdapter, a progressively aligned language model as a vision-language adapter, showing faster convergence, higher performance, and stronger scalability in multi-modal tasks with fewer parameters.
https://arxiv.org/abs//2402.10896
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
18 min - [short] In Search of Needles in a 10M Haystack: Recurrent Memory Finds What LLMs Miss
The paper introduces BABILong benchmark to evaluate transformer models on processing long documents. Fine-tuning GPT-2 with memory augmentations enables handling tasks with up to elements, a significant advancement.
https://arxiv.org/abs//2402.10790
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - In Search of Needles in a 10M Haystack: Recurrent Memory Finds What LLMs Miss
The paper introduces BABILong benchmark to evaluate transformer models on processing long documents. Fine-tuning GPT-2 with memory augmentations enables handling tasks with up to elements, a significant advancement.
https://arxiv.org/abs//2402.10790
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
14 min - [short] DoRA: Weight-Decomposed Low-Rank Adaptation
DoRA enhances fine-tuning by decomposing weights into magnitude and direction, improving learning capacity and stability over LoRA without additional inference costs, outperforming on various downstream tasks.
https://arxiv.org/abs//2402.09353
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - DoRA: Weight-Decomposed Low-Rank Adaptation
DoRA enhances fine-tuning by decomposing weights into magnitude and direction, improving learning capacity and stability over LoRA without additional inference costs, outperforming on various downstream tasks.
https://arxiv.org/abs//2402.09353
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
25 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,967 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,764 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,107 Listeners
Hard Fork
5,561 Listeners
UnHerd with Freddie Sayers
216 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
102 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners