Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • In Defense of RAG in the Era of Long-Context Language Models



    This paper introduces OP-RAG, enhancing retrieval-augmented generation for long-context applications, demonstrating improved answer quality compared to long-context LLMs through optimized retrieval strategies.


    https://arxiv.org/abs//2409.01666


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • [QA] Attention Heads of Large Language Models: A Survey



    This survey explores the interpretability of attention heads in Large Language Models, categorizing their functions and methodologies, while proposing future research directions to enhance understanding of LLM reasoning processes.


    https://arxiv.org/abs//2409.03752


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Attention Heads of Large Language Models: A Survey



    This survey explores the interpretability of attention heads in Large Language Models, categorizing their functions and methodologies, while proposing future research directions to enhance understanding of LLM reasoning processes.


    https://arxiv.org/abs//2409.03752


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    27 min
  • [QA] The AdEMAMix Optimizer: Better, Faster, Older



    This paper critiques single EMA usage in momentum optimizers, proposing AdEMAMix, which combines two EMAs for improved gradient relevance, faster convergence, and reduced model forgetting in training.


    https://arxiv.org/abs//2409.03137


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • The AdEMAMix Optimizer: Better, Faster, Older



    This paper critiques single EMA usage in momentum optimizers, proposing AdEMAMix, which combines two EMAs for improved gradient relevance, faster convergence, and reduced model forgetting in training.


    https://arxiv.org/abs//2409.03137


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    18 min
  • [QA] Planning In Natural Language Improves LLM Search For Code Generation



    The paper introduces PLANSEARCH, a novel search algorithm that enhances diversity in LLM outputs, improving performance on coding benchmarks by exploring natural language plans instead of direct code solutions.


    https://arxiv.org/abs//2409.03733


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • Planning In Natural Language Improves LLM Search For Code Generation



    The paper introduces PLANSEARCH, a novel search algorithm that enhances diversity in LLM outputs, improving performance on coding benchmarks by exploring natural language plans instead of direct code solutions.


    https://arxiv.org/abs//2409.03733


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    26 min
  • [QA] MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark



    MMMU-Pro enhances the MMMU benchmark to rigorously evaluate multimodal models' understanding and reasoning, revealing lower performance and offering insights for future multimodal AI research.


    https://arxiv.org/abs//2409.02813


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    11 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

966 Listeners

Odd Lots by Bloomberg

Odd Lots

1,963 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

436 Listeners

The Daily by The New York Times

The Daily

111,727 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,106 Listeners

Hard Fork by The New York Times

Hard Fork

5,565 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

216 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

102 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners