Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- SAMBA: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
SAMBA is a hybrid model combining Mamba and Sliding Window Attention for efficient sequence modeling with infinite context length, outperforming existing models.
https://arxiv.org/abs//2406.07522
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
14 min - [QA] Why Warmup the Learning Rate? Underlying Mechanisms and Improvements
The paper explores the benefits of warmup in deep learning, showing how it improves performance by allowing networks to handle larger learning rates and suggesting alternative initialization methods.
https://arxiv.org/abs//2406.09405
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
7 min - Why Warmup the Learning Rate? Underlying Mechanisms and Improvements
The paper explores the benefits of warmup in deep learning, showing how it improves performance by allowing networks to handle larger learning rates and suggesting alternative initialization methods.
https://arxiv.org/abs//2406.09405
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
22 min - [QA] An Image is Worth More Than 1616 Patches: Exploring Transformers on Individual Pixels
Vanilla Transformers can achieve high performance in computer vision by treating individual pixels as tokens, challenging the necessity of locality bias in modern architectures.
https://arxiv.org/abs//2406.09415
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
10 min - An Image is Worth More Than 1616 Patches: Exploring Transformers on Individual Pixels
Vanilla Transformers can achieve high performance in computer vision by treating individual pixels as tokens, challenging the necessity of locality bias in modern architectures.
https://arxiv.org/abs//2406.09415
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
13 min - [QA] Large Language Models Must Be Taught to Know What They Don't Know
Prompting alone is insufficient for reliable uncertainty estimation in large language models. Fine-tuning on a small dataset of correct and incorrect answers can provide better calibration with low computational cost.
https://arxiv.org/abs//2406.08391
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
11 min - Large Language Models Must Be Taught to Know What They Don't Know
Prompting alone is insufficient for reliable uncertainty estimation in large language models. Fine-tuning on a small dataset of correct and incorrect answers can provide better calibration with low computational cost.
https://arxiv.org/abs//2406.08391
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
15 min - [QA] State Soup: In-Context Skill Learning, Retrieval and Mixing
Gated-linear recurrent neural networks excel in sequence modeling due to efficient handling of long sequences. Internal states as task vectors enable fast model merging, improving performance.
https://arxiv.org/abs//2406.08423
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - State Soup: In-Context Skill Learning, Retrieval and Mixing
Gated-linear recurrent neural networks excel in sequence modeling due to efficient handling of long sequences. Internal states as task vectors enable fast model merging, improving performance.
https://arxiv.org/abs//2406.08423
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
5 min - [QA] Estimating the Hallucination Rate of Generative AI
The paper introduces a method to estimate hallucination rates in in-context learning with Generative AI, focusing on Bayesian interpretation and empirical evaluations.
https://arxiv.org/abs//2406.07457
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
10 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,960 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,708 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,107 Listeners
Hard Fork
5,564 Listeners
UnHerd with Freddie Sayers
216 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
101 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners