Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- Dynamic Memory Compression: Retrofitting LLMs for Accelerated Inference
Dynamic Memory Compression (DMC) optimizes key-value cache for Transformers, enhancing generation efficiency without compromising performance, achieving up to 3.7x throughput increase on LLMs like Llama 2.
https://arxiv.org/abs//2403.09636
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
20 min - [short] Logits of API-Protected LLMs Leak Proprietary Information
API queries can reveal hidden information about protected large language models due to a softmax bottleneck, enabling various capabilities and suggesting transparency measures for LLM providers.
https://arxiv.org/abs//2403.09539
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - Logits of API-Protected LLMs Leak Proprietary Information
API queries can reveal hidden information about protected large language models due to a softmax bottleneck, enabling various capabilities and suggesting transparency measures for LLM providers.
https://arxiv.org/abs//2403.09539
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
18 min - [short] Reawakening knowledge: Anticipatory recovery from catastrophic interference via structured training
Paper explores neural network training dynamics in structured non-IID settings. Networks exhibit anticipatory behavior, recovering from forgetting on documents before encountering them again. Insights for training over-parameterized networks.
https://arxiv.org/abs//2403.09613
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - Reawakening knowledge: Anticipatory recovery from catastrophic interference via structured training
Paper explores neural network training dynamics in structured non-IID settings. Networks exhibit anticipatory behavior, recovering from forgetting on documents before encountering them again. Insights for training over-parameterized networks.
https://arxiv.org/abs//2403.09613
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
21 min - [short] MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training
The paper explores building high-performing Multimodal Large Language Models (MLLMs) by studying architecture components and data choices, emphasizing the importance of multimodal pre-training for state-of-the-art results.
https://arxiv.org/abs//2403.09611
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training
The paper explores building high-performing Multimodal Large Language Models (MLLMs) by studying architecture components and data choices, emphasizing the importance of multimodal pre-training for state-of-the-art results.
https://arxiv.org/abs//2403.09611
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
12 min - Gemma: Open Models Based on Gemini Research and Technology
https://arxiv.org/abs//2403.08295
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
14 min - [short] Language models scale reliably with over-training and on downstream tasks
The paper addresses gaps in scaling studies for language models by exploring over-training and predicting downstream task performance, presenting findings and predictions with reduced computational costs.
https://arxiv.org/abs//2403.08540
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
2 min - Language models scale reliably with over-training and on downstream tasks
The paper addresses gaps in scaling studies for language models by exploring over-training and predicting downstream task performance, presenting findings and predictions with reduced computational costs.
https://arxiv.org/abs//2403.08540
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
7 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,960 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,708 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,107 Listeners
Hard Fork
5,564 Listeners
UnHerd with Freddie Sayers
216 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
101 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners