Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [QA] Layer-Condensed KV Cache for Efficient Inference of Large Language Models
Proposed method reduces memory consumption in large language models by caching KVs of a small number of layers, improving throughput by up to 26% with competitive performance.
https://arxiv.org/abs//2405.10637
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Layer-Condensed KV Cache for Efficient Inference of Large Language Models
Proposed method reduces memory consumption in large language models by caching KVs of a small number of layers, improving throughput by up to 26% with competitive performance.
https://arxiv.org/abs//2405.10637
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
10 min - [QA] Observational Scaling Laws and the Predictability of Language Model Performance
Proposing an observational approach to understand language model scaling laws using 80 public models, showing predictability of model performance and emergent phenomena without extensive training across scales.
https://arxiv.org/abs//2405.10938
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
10 min - Observational Scaling Laws and the Predictability of Language Model Performance
Proposing an observational approach to understand language model scaling laws using 80 public models, showing predictability of model performance and emergent phenomena without extensive training across scales.
https://arxiv.org/abs//2405.10938
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
26 min - [QA] Zero-Shot Tokenizer Transfer
This paper introduces Zero-Shot Tokenizer Transfer (ZeTT) to enable swapping tokenizers in language models, improving efficiency across languages and coding tasks without performance degradation.
https://arxiv.org/abs//2405.07883
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
10 min - Zero-Shot Tokenizer Transfer
This paper introduces Zero-Shot Tokenizer Transfer (ZeTT) to enable swapping tokenizers in language models, improving efficiency across languages and coding tasks without performance degradation.
https://arxiv.org/abs//2405.07883
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
14 min - [QA] Many-Shot In-Context Learning in Multimodal Foundation Models
Multimodal foundation models show improved performance in many-shot in-context learning, with Gemini 1.5 Pro demonstrating higher efficiency and scalability compared to GPT-4o.
https://arxiv.org/abs//2405.09798
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
12 min - Many-Shot In-Context Learning in Multimodal Foundation Models
Multimodal foundation models show improved performance in many-shot in-context learning, with Gemini 1.5 Pro demonstrating higher efficiency and scalability compared to GPT-4o.
https://arxiv.org/abs//2405.09798
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
11 min - [QA] Chameleon: Mixed-Modal Early-Fusion Foundation Models
https://arxiv.org/abs//2405.09818
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Chameleon: Mixed-Modal Early-Fusion Foundation Models
https://arxiv.org/abs//2405.09818
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
20 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,960 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,708 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,107 Listeners
Hard Fork
5,564 Listeners
UnHerd with Freddie Sayers
216 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
101 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners