Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • [short] On Limitations of the Transformer Architecture

    The paper explores the root causes of hallucinations in large language models, demonstrating the Transformer layer's limitations in composing functions for tasks like genealogy identification.


    https://arxiv.org/abs//2402.08164


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    3 min
  • On Limitations of the Transformer Architecture

    The paper explores the root causes of hallucinations in large language models, demonstrating the Transformer layer's limitations in composing functions for tasks like genealogy identification.


    https://arxiv.org/abs//2402.08164


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    22 min
  • Chain-of-Thought Reasoning Without Prompting

    https://arxiv.org/abs//2402.10200


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

    22 min
  • [short] How to Train Data-Efficient LLMs

    Study explores data-efficient pre-training methods for large language models. ASK-LLM assesses data quality, DENSITY sampling selects diverse samples. Both outperform full-data training.


    https://arxiv.org/abs//2402.09668


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

    3 min
  • How to Train Data-Efficient LLMs

    Study explores data-efficient pre-training methods for large language models. ASK-LLM assesses data quality, DENSITY sampling selects diverse samples. Both outperform full-data training.


    https://arxiv.org/abs//2402.09668


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    23 min
  • [short] Data Engineering for Scaling Language Models to 128K Context

    Study explores continual pretraining for scaling language models' context lengths to 128K, emphasizing data engineering's importance in achieving optimal performance and closing the gap to top models.


    https://arxiv.org/abs//2402.10171


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    3 min
  • Data Engineering for Scaling Language Models to 128K Context

    Study explores continual pretraining for scaling language models' context lengths to 128K, emphasizing data engineering's importance in achieving optimal performance and closing the gap to top models.


    https://arxiv.org/abs//2402.10171


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    19 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,967 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

436 Listeners

The Daily by The New York Times

The Daily

111,764 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,107 Listeners

Hard Fork by The New York Times

Hard Fork

5,561 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

216 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

102 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners