Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [QA] Should We Still Pretrain Encoders with Masked Language Modeling?
This paper compares Masked Language Modeling and Causal Language Modeling for text representation, finding MLM generally performs better, but CLM offers data efficiency and stability, suggesting a biphasic training strategy.
https://arxiv.org/abs//2507.00994
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Should We Still Pretrain Encoders with Masked Language Modeling?
This paper compares Masked Language Modeling and Causal Language Modeling for text representation, finding MLM generally performs better, but CLM offers data efficiency and stability, suggesting a biphasic training strategy.
https://arxiv.org/abs//2507.00994
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
17 min - [QA] Token Bottleneck: One Token to Remember Dynamics
The paper presents Token Bottleneck (ToBo), a self-supervised learning method for compact visual representations, enhancing sequential scene understanding and demonstrating effectiveness in various tasks and real-world applications.
https://arxiv.org/abs//2507.06543
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Token Bottleneck: One Token to Remember Dynamics
The paper presents Token Bottleneck (ToBo), a self-supervised learning method for compact visual representations, enhancing sequential scene understanding and demonstrating effectiveness in various tasks and real-world applications.
https://arxiv.org/abs//2507.06543
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
17 min - [QA] A Systematic Analysis of Hybrid Linear Attention
https://arxiv.org/abs//2507.06457
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - A Systematic Analysis of Hybrid Linear Attention
https://arxiv.org/abs//2507.06457
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
16 min - [QA] First Return, Entropy-Eliciting Explore
https://arxiv.org/abs//2507.07017
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - First Return, Entropy-Eliciting Explore
https://arxiv.org/abs//2507.07017
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
22 min - [QA] Skip a Layer or Loop it? Test-Time Depth Adaptation of Pretrained LLMs
Pretrained neural networks can adapt their architecture dynamically for different inputs, improving efficiency and performance by customizing layer usage without finetuning, as shown through Monte Carlo Tree Search optimization.
https://arxiv.org/abs//2507.07996
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Skip a Layer or Loop it? Test-Time Depth Adaptation of Pretrained LLMs
Pretrained neural networks can adapt their architecture dynamically for different inputs, improving efficiency and performance by customizing layer usage without finetuning, as shown through Monte Carlo Tree Search optimization.
https://arxiv.org/abs//2507.07996
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
16 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,964 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
438 Listeners
The Daily
111,734 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,100 Listeners
Hard Fork
5,569 Listeners
UnHerd with Freddie Sayers
217 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
102 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners