Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- The Remarkable Robustness of LLMs: Stages of Inference?
The study explores Large Language Models' robustness by deleting and swapping layers, finding interventions retain 72-95% accuracy without fine-tuning, with more layers showing increased robustness.
https://arxiv.org/abs//2406.19384
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
16 min - [QA] Do LLMs dream of elephants (when told not to)? Latent concept association and associative memory in transformers
Large Language Models can easily manipulate fact retrieval by changing contexts, behaving like associative memory models. Transformers use self-attention and value matrix for memory tasks.
https://arxiv.org/abs//2406.18400
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
10 min - Do LLMs dream of elephants (when told not to)? Latent concept association and associative memory in transformers
Large Language Models can easily manipulate fact retrieval by changing contexts, behaving like associative memory models. Transformers use self-attention and value matrix for memory tasks.
https://arxiv.org/abs//2406.18400
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
17 min - [QA] Data curation via joint example selection further accelerates multimodal learning
Jointly selecting batches of data improves learning in large-scale pretraining. Multimodal contrastive objectives reveal data dependencies, leading to faster training with reduced computational overhead.
https://arxiv.org/abs//2406.17711
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Data curation via joint example selection further accelerates multimodal learning
Jointly selecting batches of data improves learning in large-scale pretraining. Multimodal contrastive objectives reveal data dependencies, leading to faster training with reduced computational overhead.
https://arxiv.org/abs//2406.17711
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
14 min - [QA] Large Language Models are Interpretable Learners
Combining Large Language Models with symbolic programs creates interpretable and accurate decision rules, bridging the gap between expressiveness and interpretability in predictive models.
https://arxiv.org/abs//2406.17224
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
10 min - Large Language Models are Interpretable Learners
Combining Large Language Models with symbolic programs creates interpretable and accurate decision rules, bridging the gap between expressiveness and interpretability in predictive models.
https://arxiv.org/abs//2406.17224
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
21 min - [QA] Recite, Reconstruct, Recollect: Memorization in LMs as a Multifaceted Phenomenon
Memorization in language models is complex and influenced by various factors. A taxonomy approach helps understand and predict memorization patterns.
https://arxiv.org/abs//2406.17746
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Recite, Reconstruct, Recollect: Memorization in LMs as a Multifaceted Phenomenon
Memorization in language models is complex and influenced by various factors. A taxonomy approach helps understand and predict memorization patterns.
https://arxiv.org/abs//2406.17746
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
13 min - [QA] Adam-mini: Use Fewer Learning Rates To Gain More
Adam-mini optimizer reduces memory footprint by using average learning rates within parameter blocks, achieving performance comparable to AdamW with significantly less memory.
https://arxiv.org/abs//2406.16793
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,960 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,708 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,107 Listeners
Hard Fork
5,564 Listeners
UnHerd with Freddie Sayers
216 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
101 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners