Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • [QA] Antidistillation Sampling



    Antidistillation sampling modifies token probability distributions to weaken reasoning traces for model distillation, enhancing model security while maintaining performance.


    https://arxiv.org/abs//2504.13146


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Antidistillation Sampling



    Antidistillation sampling modifies token probability distributions to weaken reasoning traces for model distillation, enhancing model security while maintaining performance.


    https://arxiv.org/abs//2504.13146


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    11 min
  • [QA] Position: The Most Expensive Part of an LLM should be its Training Data



    This paper argues that compensating human labor for training data is the largest cost in developing Large Language Models, significantly exceeding model training expenses, and suggests fairer practices for the future.


    https://arxiv.org/abs//2504.12427


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Position: The Most Expensive Part of an LLM should be its Training Data



    This paper argues that compensating human labor for training data is the largest cost in developing Large Language Models, significantly exceeding model training expenses, and suggests fairer practices for the future.


    https://arxiv.org/abs//2504.12427


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    21 min
  • [QA] Activated LoRA: Fine-tuned LLMs for Intrinsics



    Activated LoRA (aLoRA) enhances LoRA by adapting weights only for relevant tokens, allowing instant activation without recomputing the KV cache, improving efficiency in multiturn settings.


    https://arxiv.org/abs//2504.12397


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • Activated LoRA: Fine-tuned LLMs for Intrinsics



    Activated LoRA (aLoRA) enhances LoRA by adapting weights only for relevant tokens, allowing instant activation without recomputing the KV cache, improving efficiency in multiturn settings.


    https://arxiv.org/abs//2504.12397


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    19 min
  • [QA] COLORBENCH: Can VLMs See and Understand the Colorful World?



    The paper presents COLORBENCH, a benchmark to evaluate vision-language models' color understanding, revealing limitations and emphasizing the need for improved color comprehension in multimodal AI.


    https://arxiv.org/abs//2504.10514


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • COLORBENCH: Can VLMs See and Understand the Colorful World?



    The paper presents COLORBENCH, a benchmark to evaluate vision-language models' color understanding, revealing limitations and emphasizing the need for improved color comprehension in multimodal AI.


    https://arxiv.org/abs//2504.10514


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    21 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,964 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

438 Listeners

The Daily by The New York Times

The Daily

111,734 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,100 Listeners

Hard Fork by The New York Times

Hard Fork

5,569 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

217 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

102 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners