Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • [short] Greed is All You Need: An Evaluation of Tokenizer Inference Methods

    Study compares tokenization methods for NLP models, finding greedy inference effective and SaGe superior for morphological alignment.


    https://arxiv.org/abs//2403.01289


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    3 min
  • Greed is All You Need: An Evaluation of Tokenizer Inference Methods

    Study compares tokenization methods for NLP models, finding greedy inference effective and SaGe superior for morphological alignment.


    https://arxiv.org/abs//2403.01289


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    14 min
  • [short] Simple linear attention language models balance the recall-throughput tradeoff

    Efficient language model architecture balancing recall and memory usage through a novel linear and sliding window attention approach outperforms sub-quadratic models on recall-intensive tasks.


    https://arxiv.org/abs//2402.18668


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    3 min
  • Simple linear attention language models balance the recall-throughput tradeoff

    Efficient language model architecture balancing recall and memory usage through a novel linear and sliding window attention approach outperforms sub-quadratic models on recall-intensive tasks.


    https://arxiv.org/abs//2402.18668


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    36 min
  • [short] Beyond Language Models: Byte Models are Digital World Simulators

    bGPT introduces next byte prediction to deep learning, achieving high performance across text, audio, and images, and excelling in simulating digital processes with low error rates.


    https://arxiv.org/abs//2402.19155


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    3 min
  • Beyond Language Models: Byte Models are Digital World Simulators

    bGPT introduces next byte prediction to deep learning, achieving high performance across text, audio, and images, and excelling in simulating digital processes with low error rates.


    https://arxiv.org/abs//2402.19155


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    25 min
  • [short] The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

    Introduction of BitNet b1.58, a 1-bit Large Language Model variant, matches full-precision models in performance while being more cost-effective, paving the way for efficient LLM training and hardware design.


    https://arxiv.org/abs//2402.17764


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    3 min
  • The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

    Introduction of BitNet b1.58, a 1-bit Large Language Model variant, matches full-precision models in performance while being more cost-effective, paving the way for efficient LLM training and hardware design.


    https://arxiv.org/abs//2402.17764


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    14 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,960 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

436 Listeners

The Daily by The New York Times

The Daily

111,708 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,107 Listeners

Hard Fork by The New York Times

Hard Fork

5,564 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

216 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

101 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners