Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • [QA] Kangaroo: Lossless Self-Speculative Decoding via Double Early Exiting



    Kangaroo introduces a self-speculative decoding framework for accelerating large language model inference, using a shallow sub-network and early exiting mechanisms to improve efficiency.


    https://arxiv.org/abs//2404.18911


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Kangaroo: Lossless Self-Speculative Decoding via Double Early Exiting



    Kangaroo introduces a self-speculative decoding framework for accelerating large language model inference, using a shallow sub-network and early exiting mechanisms to improve efficiency.


    https://arxiv.org/abs//2404.18911


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    7 min
  • [QA] Talking Nonsense: Probing Large Language Models' Understanding of Adversarial Gibberish Inputs



    Study explores if large language models understand their own language. Greedy Coordinate Gradient optimizer crafts prompts to compel coherent responses from nonsensical inputs, revealing efficiency and robustness differences.


    https://arxiv.org/abs//2404.17120


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    10 min
  • Talking Nonsense: Probing Large Language Models' Understanding of Adversarial Gibberish Inputs


    Study explores if large language models understand their own language. Greedy Coordinate Gradient optimizer crafts prompts to compel coherent responses from nonsensical inputs, revealing efficiency and robustness differences.


    https://arxiv.org/abs//2404.17120


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    15 min
  • [QA] Let’s Think Dot by Dot: Hidden Computation in Transformer Language Models



    Transformers can use meaningless filler tokens to solve tasks, but learning to use them is challenging. Additional tokens can provide computational benefits independently of token choice.


    https://arxiv.org/abs//2404.15758


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • Let’s Think Dot by Dot: Hidden Computation in Transformer Language Models



    Transformers can use meaningless filler tokens to solve tasks, but learning to use them is challenging. Additional tokens can provide computational benefits independently of token choice.


    https://arxiv.org/abs//2404.15758


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    15 min
  • [QA] Retrieval Head Mechanistically Explains Long-Context Factuality



    This paper investigates how transformer-based language models retrieve information from long contexts, identifying special attention heads called retrieval heads as crucial for this task.


    https://arxiv.org/abs//2404.15574


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    11 min
  • Retrieval Head Mechanistically Explains Long-Context Factuality



    This paper investigates how transformer-based language models retrieve information from long contexts, identifying special attention heads called retrieval heads as crucial for this task.


    https://arxiv.org/abs//2404.15574


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    10 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,960 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

436 Listeners

The Daily by The New York Times

The Daily

111,708 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,107 Listeners

Hard Fork by The New York Times

Hard Fork

5,564 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

216 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

101 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners