Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • [short] Fully-fused Multi-Layer Perceptrons on Intel Data Center GPUs



    SYCL MLP implementation optimized for Intel Data Center GPU Max 1550 improves performance by minimizing global memory accesses, increasing data reuse, outperforming CUDA in various applications.


    https://arxiv.org/abs//2403.17607


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    3 min
  • Fully-fused Multi-Layer Perceptrons on Intel Data Center GPUs



    SYCL MLP implementation optimized for Intel Data Center GPU Max 1550 improves performance by minimizing global memory accesses, increasing data reuse, outperforming CUDA in various applications.


    https://arxiv.org/abs//2403.17607


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    20 min
  • [short] The Unreasonable Ineffectiveness of the Deeper Layers



    Study explores layer pruning in pretrained LLMs, finding minimal performance drop until half of layers removed. Optimal block identified for pruning, followed by finetuning with PEFT methods for efficiency and improved inference.


    https://arxiv.org/abs//2403.17887


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    3 min
  • The Unreasonable Ineffectiveness of the Deeper Layers



    Study explores layer pruning in pretrained LLMs, finding minimal performance drop until half of layers removed. Optimal block identified for pruning, followed by finetuning with PEFT methods for efficiency and improved inference.


    https://arxiv.org/abs//2403.17887


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    18 min
  • [short] Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance



    Quantitative data mixing laws predict large language model performance based on mixture proportions, guiding optimal data selection and training strategies for improved outcomes.


    https://arxiv.org/abs//2403.16952


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    3 min
  • Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance



    Quantitative data mixing laws predict large language model performance based on mixture proportions, guiding optimal data selection and training strategies for improved outcomes.


    https://arxiv.org/abs//2403.16952


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    21 min
  • [short] LLM Agent Operating System



    AIOS is an operating system integrating large language models to optimize resource allocation, context switching, and concurrent agent execution, aiming to enhance LLM agent performance and efficiency.


    https://arxiv.org/abs//2403.16971


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    4 min
  • LLM Agent Operating System

    AIOS is an operating system integrating large language models to optimize resource allocation, context switching, and concurrent agent execution, aiming to enhance LLM agent performance and efficiency.


    https://arxiv.org/abs//2403.16971


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    18 min
  • [short] FOLLOWIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions

    FOLLOWIR introduces a dataset to help Information Retrieval models better follow complex instructions, showing potential for significant improvements in understanding and using instructions.


    https://arxiv.org/abs//2403.15246


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    3 min
  • FOLLOWIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions

    FOLLOWIR introduces a dataset to help Information Retrieval models better follow complex instructions, showing potential for significant improvements in understanding and using instructions.


    https://arxiv.org/abs//2403.15246


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    15 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,960 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

436 Listeners

The Daily by The New York Times

The Daily

111,708 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,107 Listeners

Hard Fork by The New York Times

Hard Fork

5,564 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

216 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

101 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners