Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • [short] ReALM: Reference Resolution As Language Modeling



    LLMs are powerful for reference resolution, including non-conversational entities. This paper shows how LLMs can effectively resolve various references, outperforming existing systems and even GPT-4.


    https://arxiv.org/abs//2403.20329


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    2 min
  • ReALM: Reference Resolution As Language Modeling



    LLMs are powerful for reference resolution, including non-conversational entities. This paper shows how LLMs can effectively resolve various references, outperforming existing systems and even GPT-4.


    https://arxiv.org/abs//2403.20329


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • [QA] Jamba: A Hybrid Transformer-Mamba Language Model



    Jamba is a hybrid Transformer-Mamba model with MoE, offering high performance on language tasks with efficient resource usage. Checkpoints are available for exploration.


    https://arxiv.org/abs//2403.19887


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    13 min
  • [short] Jamba: A Hybrid Transformer-Mamba Language Model



    Jamba is a hybrid Transformer-Mamba model with MoE, offering high performance on language tasks with efficient resource usage. Checkpoints are available for exploration.


    https://arxiv.org/abs//2403.19887


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    3 min
  • Jamba: A Hybrid Transformer-Mamba Language Model



    Jamba is a hybrid Transformer-Mamba model with MoE, offering high performance on language tasks with efficient resource usage. Checkpoints are available for exploration.


    https://arxiv.org/abs//2403.19887


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    15 min
  • [QA] Gecko: Versatile Text Embeddings Distilled from Large Language Models



    The paper explores the impact of social media on mental health, focusing on the relationship between social media use and psychological well-being among adolescents.


    https://arxiv.org/abs//2403.20327


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    14 min
  • [short] Gecko: Versatile Text Embeddings Distilled from Large Language Models



    The paper explores the impact of social media on mental health, focusing on the relationship between social media use and psychological well-being among adolescents.


    https://arxiv.org/abs//2403.20327


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    2 min
  • Gecko: Versatile Text Embeddings Distilled from Large Language Models



    The paper explores the impact of social media on mental health, focusing on the relationship between social media use and psychological well-being among adolescents.


    https://arxiv.org/abs//2403.20327


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    15 min
  • [QA] LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning

    The paper introduces Layerwise Importance Sampled AdamW (LISA) as a memory-efficient alternative to Low-Rank Adaptation (LoRA) for large language models, outperforming both in various fine-tuning tasks.


    https://arxiv.org/abs//2403.17919


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    13 min
  • [short] LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning

    The paper introduces Layerwise Importance Sampled AdamW (LISA) as a memory-efficient alternative to Low-Rank Adaptation (LoRA) for large language models, outperforming both in various fine-tuning tasks.


    https://arxiv.org/abs//2403.17919


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    3 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,960 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

436 Listeners

The Daily by The New York Times

The Daily

111,708 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,107 Listeners

Hard Fork by The New York Times

Hard Fork

5,564 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

216 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

101 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners