Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- Jumping Ahead: Improving Reconstruction Fidelity with JumpReLU Sparse Autoencoders
https://arxiv.org/abs//2407.14435
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
29 min - [QA] LazyLLM: Dynamic Token Pruning for Efficient Long Context LLM Inference
LazyLLM accelerates transformer-based language model inference by dynamically selecting essential tokens for KV cache computation, improving generation speed without fine-tuning while maintaining accuracy across various tasks.
https://arxiv.org/abs//2407.14057
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - LazyLLM: Dynamic Token Pruning for Efficient Long Context LLM Inference
LazyLLM accelerates transformer-based language model inference by dynamically selecting essential tokens for KV cache computation, improving generation speed without fine-tuning while maintaining accuracy across various tasks.
https://arxiv.org/abs//2407.14057
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
24 min - [QA] Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies
This study highlights the importance of vocabulary size in scaling large language models, proposing optimal sizes that enhance performance, particularly for models like Llama2-70B.
https://arxiv.org/abs//2407.13623
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies
This study highlights the importance of vocabulary size in scaling large language models, proposing optimal sizes that enhance performance, particularly for models like Llama2-70B.
https://arxiv.org/abs//2407.13623
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
35 min - [QA] NeedleBench: Can LLMs Do Retrieval and Reasoning in 1 Million Context Window?
NeedleBench evaluates large language models' long-context capabilities, highlighting their struggles with logical reasoning in bilingual texts and suggesting improvements for practical applications. Resources are available at OpenCompass.
https://arxiv.org/abs//2407.11963
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - NeedleBench: Can LLMs Do Retrieval and Reasoning in 1 Million Context Window?
NeedleBench evaluates large language models' long-context capabilities, highlighting their struggles with logical reasoning in bilingual texts and suggesting improvements for practical applications. Resources are available at OpenCompass.
https://arxiv.org/abs//2407.11963
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
26 min - [QA] Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
Q-Sparse is an efficient method for training sparsely-activated large language models, achieving comparable results to baseline models while significantly improving inference efficiency and reducing costs.
https://arxiv.org/abs//2407.10969
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
Q-Sparse is an efficient method for training sparsely-activated large language models, achieving comparable results to baseline models while significantly improving inference efficiency and reducing costs.
https://arxiv.org/abs//2407.10969
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
22 min - [QA] Foundational Autoraters: Taming Large Language Models for Better Automatic Evaluation
https://arxiv.org/abs//2407.10817
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,960 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,708 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,107 Listeners
Hard Fork
5,564 Listeners
UnHerd with Freddie Sayers
216 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
101 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners