Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • [QA] Scaling Retrieval-Based Language Models with a Trillion-Token Datastore



    This paper explores how increasing datastore size enhances retrieval-based language models' performance, demonstrating that smaller models with large datastores outperform larger models in knowledge-intensive tasks.


    https://arxiv.org/abs//2407.12854


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    16 min
  • Scaling Retrieval-Based Language Models with a Trillion-Token Datastore



    This paper explores how increasing datastore size enhances retrieval-based language models' performance, demonstrating that smaller models with large datastores outperform larger models in knowledge-intensive tasks.


    https://arxiv.org/abs//2407.12854


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    31 min
  • [QA] Beyond KV Caching: Shared Attention for Efficient LLMs



    This paper presents a Shared Attention mechanism that improves the efficiency of large language models by sharing attention weights across layers, reducing computational resources while maintaining performance.


    https://arxiv.org/abs//2407.12866


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    17 min
  • Beyond KV Caching: Shared Attention for Efficient LLMs



    This paper presents a Shared Attention mechanism that improves the efficiency of large language models by sharing attention weights across layers, reducing computational resources while maintaining performance.


    https://arxiv.org/abs//2407.12866


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    24 min
  • [QA] Private prediction for large-scale synthetic text generation



    Approach for generating differentially private synthetic text using large language models through private prediction, enabling creation of thousands of high-quality data points for various applications.


    https://arxiv.org/abs//2407.12108


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • Private prediction for large-scale synthetic text generation1



    Approach for generating differentially private synthetic text using large language models through private prediction, enabling creation of thousands of high-quality data points for various applications.


    https://arxiv.org/abs//2407.12108


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    15 min
  • [QA] Chip Placement with Diffusion



    Novel diffusion model for macro placement in digital circuit design outperforms existing reinforcement learning methods by placing all components simultaneously.


    https://arxiv.org/abs//2407.12282


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Chip Placement with Diffusion



    Novel diffusion model for macro placement in digital circuit design outperforms existing reinforcement learning methods by placing all components simultaneously.


    https://arxiv.org/abs//2407.12282


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    13 min
  • [QA] Unraveling the Truth: Do LLMs really Understand Charts? A Deep Dive into Consistency and Robustness



    This paper evaluates Visual Language Models for Chart Question Answering, revealing performance variations and proposing improvements for more robust systems in diverse question and chart scenarios.


    https://arxiv.org/abs//2407.11229


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    10 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,960 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

436 Listeners

The Daily by The New York Times

The Daily

111,708 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,107 Listeners

Hard Fork by The New York Times

Hard Fork

5,564 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

216 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

101 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners