Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • [QA] Flat Channels to Infinity in Neural Loss Landscapes



    The paper characterizes special channels in neural network loss landscapes where slow loss decrease occurs, leading to gated linear units, enhancing understanding of gradient dynamics and optimization methods.


    https://arxiv.org/abs//2506.14951


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Flat Channels to Infinity in Neural Loss Landscapes



    The paper characterizes special channels in neural network loss landscapes where slow loss decrease occurs, leading to gated linear units, enhancing understanding of gradient dynamics and optimization methods.


    https://arxiv.org/abs//2506.14951


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    16 min
  • [QA] Approximating Language Model Training Data from Weights



    The paper presents a method for approximating training data from model weights, improving performance significantly on classification tasks using a gradient-based approach to select relevant public documents.


    https://arxiv.org/abs//2506.15553


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Approximating Language Model Training Data from Weights



    The paper presents a method for approximating training data from model weights, improving performance significantly on classification tasks using a gradient-based approach to select relevant public documents.


    https://arxiv.org/abs//2506.15553


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    22 min
  • [QA] GenRecal: Generation after Recalibration from Large to Small Vision-Language Models



    GenRecal is a novel distillation framework for vision-language models that enhances knowledge transfer across diverse architectures, improving performance on resource-constrained devices while outperforming large-scale VLMs.


    https://arxiv.org/abs//2506.15681


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • GenRecal: Generation after Recalibration from Large to Small Vision-Language Models



    GenRecal is a novel distillation framework for vision-language models that enhances knowledge transfer across diverse architectures, improving performance on resource-constrained devices while outperforming large-scale VLMs.


    https://arxiv.org/abs//2506.15681


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    18 min
  • [QA] Sampling from Your Language Model One Byte at a Time



    This paper presents a method to convert autoregressive language models with BPE tokenizers into character-level models, addressing tokenization issues and enabling model interoperability and improved performance through ensemble and proxy-tuning.


    https://arxiv.org/abs//2506.14123


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Sampling from Your Language Model One Byte at a Time



    This paper presents a method to convert autoregressive language models with BPE tokenizers into character-level models, addressing tokenization issues and enabling model interoperability and improved performance through ensemble and proxy-tuning.


    https://arxiv.org/abs//2506.14123


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    14 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,964 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

438 Listeners

The Daily by The New York Times

The Daily

111,734 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,100 Listeners

Hard Fork by The New York Times

Hard Fork

5,569 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

217 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

102 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners