Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [QA] Pre-training Large Memory Language Models with Internal and External Knowledge
We introduce Large Memory Language Models (LMLMs) that store factual knowledge externally, enabling targeted lookups and improving verifiability, while maintaining competitive performance on standard benchmarks.
https://arxiv.org/abs//2505.15962
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Pre-training Large Memory Language Models with Internal and External Knowledge
We introduce Large Memory Language Models (LMLMs) that store factual knowledge externally, enabling targeted lookups and improving verifiability, while maintaining competitive performance on standard benchmarks.
https://arxiv.org/abs//2505.15962
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
21 min - [QA] Understanding Prompt Tuning and In-Context Learning via Meta-Learning height2pt
The paper explores optimal prompting through a Bayesian perspective, highlighting limitations and advantages of prompt optimization methods, supported by experiments on LSTMs and Transformers.
https://arxiv.org/abs//2505.17010
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Understanding Prompt Tuning and In-Context Learning via Meta-Learning height2pt
The paper explores optimal prompting through a Bayesian perspective, highlighting limitations and advantages of prompt optimization methods, supported by experiments on LSTMs and Transformers.
https://arxiv.org/abs//2505.17010
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
22 min - [QA] Set-LLM: A Permutation-Invariant LLM
This paper presents Set-LLM, an architectural adaptation for large language models that ensures permutation invariance, addressing order sensitivity and improving performance in various applications.
https://arxiv.org/abs//2505.15433
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Set-LLM: A Permutation-Invariant LLM
This paper presents Set-LLM, an architectural adaptation for large language models that ensures permutation invariance, addressing order sensitivity and improving performance in various applications.
https://arxiv.org/abs//2505.15433
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
24 min - [QA] On the creation of narrow AI: hierarchy and nonlocality of neural network skills
This paper explores creating efficient narrow AI systems, addressing challenges in training from scratch and skill transfer from large models, highlighting pruning methods and regularization for improved performance.
https://arxiv.org/abs//2505.15811
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - On the creation of narrow AI: hierarchy and nonlocality of neural network skills
This paper explores creating efficient narrow AI systems, addressing challenges in training from scratch and skill transfer from large models, highlighting pruning methods and regularization for improved performance.
https://arxiv.org/abs//2505.15811
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
19 min - [QA] Do Language Models Use Their Depth Efficiently?
The study analyzes Llama 3.1 and Qwen 3 models, finding deeper layers contribute less and do not perform new computations, explaining diminishing returns in stacked Transformer architectures.
https://arxiv.org/abs//2505.13898
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Do Language Models Use Their Depth Efficiently?
The study analyzes Llama 3.1 and Qwen 3 models, finding deeper layers contribute less and do not perform new computations, explaining diminishing returns in stacked Transformer architectures.
https://arxiv.org/abs//2505.13898
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
21 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,964 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
438 Listeners
The Daily
111,734 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,100 Listeners
Hard Fork
5,569 Listeners
UnHerd with Freddie Sayers
217 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
102 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners