Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • [QA] Dolphin: Long Context as a New Modality for Energy-Efficient On-Device Language Models



    Dolphin is an energy-efficient decoder-decoder architecture for processing long contexts in language models, achieving significant improvements in energy efficiency and latency while maintaining response quality.


    https://arxiv.org/abs//2408.15518


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Dolphin: Long Context as a New Modality for Energy-Efficient On-Device Language Models



    Dolphin is an energy-efficient decoder-decoder architecture for processing long contexts in language models, achieving significant improvements in energy efficiency and latency while maintaining response quality.


    https://arxiv.org/abs//2408.15518


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    17 min
  • [QA] CycleGAN with Better Cycles



    This project proposes three modifications to CycleGAN's pixel-level cycle consistency, improving image quality and reducing artifacts in unpaired image-to-image translation tasks.


    https://arxiv.org/abs//2408.15374


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • CycleGAN with Better Cycles



    This project proposes three modifications to CycleGAN's pixel-level cycle consistency, improving image quality and reducing artifacts in unpaired image-to-image translation tasks.


    https://arxiv.org/abs//2408.15374


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    10 min
  • [QA] The Mamba in the Llama: Distilling and Accelerating Hybrid Models



    The paper demonstrates distilling large Transformer models into efficient linear RNNs, achieving competitive performance in language tasks while enhancing deployment efficiency and inference speed with limited resources.


    https://arxiv.org/abs//2408.15237


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • The Mamba in the Llama: Distilling and Accelerating Hybrid Models



    The paper demonstrates distilling large Transformer models into efficient linear RNNs, achieving competitive performance in language tasks while enhancing deployment efficiency and inference speed with limited resources.


    https://arxiv.org/abs//2408.15237


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    23 min
  • [QA] Power Scheduler: A Batch Size and Token Number Agnostic Learning Rate Scheduler



    This paper explores the correlation between learning rate, batch size, and training tokens, proposing a new Power scheduler that optimizes performance across various model sizes and architectures.


    https://arxiv.org/abs//2408.13359


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,960 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

436 Listeners

The Daily by The New York Times

The Daily

111,708 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,107 Listeners

Hard Fork by The New York Times

Hard Fork

5,564 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

216 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

101 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners