Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • An Interactive Agent Foundation Model

    The paper introduces an Interactive Agent Foundation Model for training versatile AI agents across various domains, demonstrating its effectiveness in robotics, gaming AI, and healthcare.


    https://arxiv.org/abs//2402.05929


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    23 min
  • [short] Learning to Route Among Specialized Experts for Zero-Shot Generalization

    The paper introduces lmttPHATGOOSE, a method for improving zero-shot generalization by adaptively choosing specialized language model experts for each token and layer.


    https://arxiv.org/abs//2402.05859


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    3 min
  • Learning to Route Among Specialized Experts for Zero-Shot Generalization

    The paper introduces lmttPHATGOOSE, a method for improving zero-shot generalization by adaptively choosing specialized language model experts for each token and layer.


    https://arxiv.org/abs//2402.05859


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    19 min
  • [short] Hydragen: High-Throughput LLM Inference with Shared Prefixes

    Hydragen introduces efficient attention computation for large language models, improving throughput by up to 32x and enabling the use of very long shared contexts.


    https://arxiv.org/abs//2402.05099


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    3 min
  • Hydragen: High-Throughput LLM Inference with Shared Prefixes


    Hydragen introduces efficient attention computation for large language models, improving throughput by up to 32x and enabling the use of very long shared contexts.


    https://arxiv.org/abs//2402.05099


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    21 min
  • [short] Direct Language Model Alignment from Online AI Feedback


    Direct alignment from preferences (DAP) methods lack online feedback. The study introduces online AI feedback (OAIF) using a language model annotator, outperforming offline DAP and RLHF methods.


    https://arxiv.org/abs//2402.04792


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    3 min
  • Direct Language Model Alignment from Online AI Feedback


    Direct alignment from preferences (DAP) methods lack online feedback. The study introduces online AI feedback (OAIF) using a language model annotator, outperforming offline DAP and RLHF methods.


    https://arxiv.org/abs//2402.04792


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    16 min
  • [short] Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning


    The paper compares methods for selecting high-quality data for instruction fine-tuning of LLMs and finds that selecting the 1,000 longest responses consistently outperforms sophisticated methods.


    https://arxiv.org/abs//2402.04833


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    3 min
  • Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning


    The paper compares methods for selecting high-quality data for instruction fine-tuning of LLMs and finds that selecting the 1,000 longest responses consistently outperforms sophisticated methods.


    https://arxiv.org/abs//2402.04833


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    17 min
  • [short] SELF-DISCOVER: Large Language Models Self-Compose Reasoning Structures

    SELF-DISCOVER framework enables LLMs to self-discover reasoning structures, improving performance on challenging benchmarks and outperforming inference-intensive methods while requiring fewer computations.


    https://arxiv.org/abs//2402.03620


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    2 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,967 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

436 Listeners

The Daily by The New York Times

The Daily

111,764 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,107 Listeners

Hard Fork by The New York Times

Hard Fork

5,561 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

216 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

102 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners