Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [QA] From 128K to 4M: Efficient Training of Ultra-Long Context Large Language Models
This paper presents an efficient training method for ultra-long context LLMs, extending context lengths to 4M tokens while maintaining performance on both long and short context tasks.
https://arxiv.org/abs//2504.06214
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - From 128K to 4M: Efficient Training of Ultra-Long Context Large Language Models
This paper presents an efficient training method for ultra-long context LLMs, extending context lengths to 4M tokens while maintaining performance on both long and short context tasks.
https://arxiv.org/abs//2504.06214
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
23 min - [QA] Hogwild! Inference: Parallel LLM Generation via Concurrent Attention
This paper presents Hogwild! Inference, a parallel LLM inference engine enabling LLMs to collaborate effectively using a shared attention cache, enhancing reasoning and efficiency without fine-tuning.
https://arxiv.org/abs//2504.06261
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
7 min - Hogwild! Inference: Parallel LLM Generation via Concurrent Attention
This paper presents Hogwild! Inference, a parallel LLM inference engine enabling LLMs to collaborate effectively using a shared attention cache, enhancing reasoning and efficiency without fine-tuning.
https://arxiv.org/abs//2504.06261
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
16 min - [QA] Can ChatGPT Learn My Life From a Week of First-Person Video?
The study explores how generative AI models learn personal information from first-person camera data, revealing both accurate insights and hallucinations about the wearer's life.
https://arxiv.org/abs//2504.03857
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Can ChatGPT Learn My Life From a Week of First-Person Video?
The study explores how generative AI models learn personal information from first-person camera data, revealing both accurate insights and hallucinations about the wearer's life.
https://arxiv.org/abs//2504.03857
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - [QA] Using Attention Sinks to Identify and Evaluate Dormant Heads in Pretrained LLMs
The paper introduces "dormant attention heads" in multi-head attention, analyzing their impact on model performance and revealing their early emergence and dependency on input text characteristics.
https://arxiv.org/abs//2504.03889
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Using Attention Sinks to Identify and Evaluate Dormant Heads in Pretrained LLMs
The paper introduces "dormant attention heads" in multi-head attention, analyzing their impact on model performance and revealing their early emergence and dependency on input text characteristics.
https://arxiv.org/abs//2504.03889
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
18 min - [QA] Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models
Nemotron-H models enhance inference efficiency by replacing self-attention layers with Mamba layers, achieving comparable accuracy to state-of-the-art models while being significantly faster and requiring less memory.
https://arxiv.org/abs//2504.03624
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models
Nemotron-H models enhance inference efficiency by replacing self-attention layers with Mamba layers, achieving comparable accuracy to state-of-the-art models while being significantly faster and requiring less memory.
https://arxiv.org/abs//2504.03624
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
26 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,964 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
438 Listeners
The Daily
111,734 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,100 Listeners
Hard Fork
5,569 Listeners
UnHerd with Freddie Sayers
217 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
102 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners