Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • [QA] LLM Pretraining with Continuous Concepts



    https://arxiv.org/abs//2502.08524


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • LLM Pretraining with Continuous Concepts



    Please provide the abstract you would like me to summarize.


    https://arxiv.org/abs//2502.08524


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    18 min
  • [QA] Distillation Scaling Laws



    The paper presents a distillation scaling law for optimizing model performance through compute allocation, offering guidelines for effective distillation strategies in various scenarios.


    https://arxiv.org/abs//2502.08606


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Distillation Scaling Laws



    The paper presents a distillation scaling law for optimizing model performance through compute allocation, offering guidelines for effective distillation strategies in various scenarios.


    https://arxiv.org/abs//2502.08606


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    18 min
  • [QA] Competitive Programming with Large Reasoning Models



    Reinforcement learning enhances large language models for coding tasks. The general-purpose model o3 outperforms specialized systems, achieving gold at the 2024 IOI without hand-crafted strategies.


    https://arxiv.org/abs//2502.06807


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Competitive Programming with Large Reasoning Models



    Reinforcement learning enhances large language models for coding tasks. The general-purpose model o3 outperforms specialized systems, achieving gold at the 2024 IOI without hand-crafted strategies.


    https://arxiv.org/abs//2502.06807


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    21 min
  • [QA] DeepCrossAttention: Supercharging Transformer Residual Connections



    DeepCrossAttention (DCA) enhances transformer residual learning by using dynamic weights and depth-wise cross-attention, improving model performance and speed while maintaining low parameter count.


    https://arxiv.org/abs//2502.06785


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • DeepCrossAttention: Supercharging Transformer Residual Connections



    DeepCrossAttention (DCA) enhances transformer residual learning by using dynamic weights and depth-wise cross-attention, improving model performance and speed while maintaining low parameter count.


    https://arxiv.org/abs//2502.06785


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    22 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,964 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

438 Listeners

The Daily by The New York Times

The Daily

111,734 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,100 Listeners

Hard Fork by The New York Times

Hard Fork

5,569 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

217 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

102 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners