Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • A Survey on LLM Inference-Time Self-Improvement



    This survey reviews techniques for enhancing LLM inference through computation, exploring independent, context-aware, and model-aided self-improvement, while discussing challenges and future research directions.


    https://arxiv.org/abs//2412.14352


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    24 min
  • [QA] Tokenisation is NP-Complete



    This paper proves the NP-completeness of two tokenisation variants: direct tokenisation, which finds a vocabulary, and bottom-up tokenisation, which selects merge operations for dataset compression.


    https://arxiv.org/abs//2412.15210


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Tokenisation is NP-Complete



    This paper proves the NP-completeness of two tokenisation variants: direct tokenisation, which finds a vocabulary, and bottom-up tokenisation, which selects merge operations for dataset compression.


    https://arxiv.org/abs//2412.15210


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    18 min
  • [QA] The Open-Source Advantage in Large Language Models (LLMs)



    The paper discusses the contrast between closed-source and open-source large language models, highlighting their performance, accessibility, ethical implications, and the potential for hybrid approaches in AI development.


    https://arxiv.org/abs//2412.12004


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • The Open-Source Advantage in Large Language Models (LLMs)



    The paper discusses the contrast between closed-source and open-source large language models, highlighting their performance, accessibility, ethical implications, and the potential for hybrid approaches in AI development.


    https://arxiv.org/abs//2412.12004


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    14 min
  • [QA] Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference



    ModernBERT enhances BERT with optimizations, achieving state-of-the-art performance on diverse tasks while being efficient in speed and memory for GPU inference, trained on 2 trillion tokens.


    https://arxiv.org/abs//2412.13663


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference



    ModernBERT enhances BERT with optimizations, achieving state-of-the-art performance on diverse tasks while being efficient in speed and memory for GPU inference, trained on 2 trillion tokens.


    https://arxiv.org/abs//2412.13663


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    21 min
  • [QA] DriveGPT: Scaling Autoregressive Behavior Models for Driving



    DriveGPT is a scalable transformer model for autonomous driving, enhancing decision-making and prediction through extensive training data, outperforming existing models in complex real-world scenarios.


    https://arxiv.org/abs//2412.14415


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • DriveGPT: Scaling Autoregressive Behavior Models for Driving



    DriveGPT is a scalable transformer model for autonomous driving, enhancing decision-making and prediction through extensive training data, outperforming existing models in complex real-world scenarios.


    https://arxiv.org/abs//2412.14415


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    20 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,964 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

438 Listeners

The Daily by The New York Times

The Daily

111,734 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,100 Listeners

Hard Fork by The New York Times

Hard Fork

5,569 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

217 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

102 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners