Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [QA] Solaris: A Foundation Model of the Sun
Solaris, a foundation model for solar atmosphere forecasting, utilizes 13 years of solar imagery to outperform traditional models, showcasing its potential in solar physics.
https://arxiv.org/abs//2411.16339
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Solaris: A Foundation Model of the Sun
Solaris, a foundation model for solar atmosphere forecasting, utilizes 13 years of solar imagery to outperform traditional models, showcasing its potential in solar physics.
https://arxiv.org/abs//2411.16339
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
17 min - [QA] Even Sparser Graph Transformers
Spexphormer improves Graph Transformers' efficiency by training a narrow network on an augmented graph, then using active connections to train a wider network, reducing memory requirements significantly.
https://arxiv.org/abs//2411.16278
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Even Sparser Graph Transformers
Spexphormer improves Graph Transformers' efficiency by training a narrow network on an augmented graph, then using active connections to train a wider network, reducing memory requirements significantly.
https://arxiv.org/abs//2411.16278
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
22 min - [QA] Understanding LLM Embeddings for Regression
https://arxiv.org/abs//2411.14708
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
7 min - Understanding LLM Embeddings for Regression
https://arxiv.org/abs//2411.14708
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
13 min - [QA] Loss-to-Loss Prediction: Scaling Laws for All Datasets
This paper develops a method to predict train loss across different datasets, revealing shifted power law relationships that improve accuracy over traditional single-dataset scaling laws.
https://arxiv.org/abs//2411.12925
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Loss-to-Loss Prediction: Scaling Laws for All Datasets
This paper develops a method to predict train loss across different datasets, revealing shifted power law relationships that improve accuracy over traditional single-dataset scaling laws.
https://arxiv.org/abs//2411.12925
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
22 min - [QA] When Precision Meets Position: BFloat16 Breaks Down RoPE in Long-Context Training
AnchorAttention addresses numerical issues in BFloat16 with Rotary Positional Embedding, enhancing long-context performance and training efficiency in large language models while maintaining task capabilities.
https://arxiv.org/abs//2411.13476
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - When Precision Meets Position: BFloat16 Breaks Down RoPE in Long-Context Training
AnchorAttention addresses numerical issues in BFloat16 with Rotary Positional Embedding, enhancing long-context performance and training efficiency in large language models while maintaining task capabilities.
https://arxiv.org/abs//2411.13476
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
22 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,964 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
438 Listeners
The Daily
111,734 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,100 Listeners
Hard Fork
5,569 Listeners
UnHerd with Freddie Sayers
217 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
102 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners