Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • [QA] What Matters for Model Merging at Scale?



    This study evaluates model merging at scale, revealing insights on expert model quality, size, and merging methods, ultimately enhancing generalization and performance in large-scale applications.


    https://arxiv.org/abs//2410.03617


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • What Matters for Model Merging at Scale?



    This study evaluates model merging at scale, revealing insights on expert model quality, size, and merging methods, ultimately enhancing generalization and performance in large-scale applications.


    https://arxiv.org/abs//2410.03617


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    25 min
  • [QA] Depth Pro: Sharp Monocular Metric Depth in Less Than a Second



    Depth Pro is a fast foundation model for zero-shot monocular depth estimation, producing high-resolution, metric depth maps without metadata, outperforming previous methods in accuracy and detail.


    https://arxiv.org/abs//2410.02073


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Depth Pro: Sharp Monocular Metric Depth in Less Than a Second



    Depth Pro is a fast foundation model for zero-shot monocular depth estimation, producing high-resolution, metric depth maps without metadata, outperforming previous methods in accuracy and detail.


    https://arxiv.org/abs//2410.02073


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    15 min
  • [QA] Were RNNs All We Needed?



    This work revisits LSTMs and GRUs, introducing minimal versions that eliminate hidden state dependencies, enabling efficient parallel training while matching the performance of recent sequence models.


    https://arxiv.org/abs//2410.01201


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    10 min
  • Were RNNs All We Needed?



    This work revisits LSTMs and GRUs, introducing minimal versions that eliminate hidden state dependencies, enabling efficient parallel training while matching the performance of recent sequence models.


    https://arxiv.org/abs//2410.01201


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    17 min
  • [QA] OOD-CHAMELEON: Is Algorithm Selection for OOD Generalization Learnable?



    The paper introduces OOD-CHAMELEON, a method for selecting algorithms for out-of-distribution generalization by predicting performance based on dataset characteristics, outperforming individual algorithms and heuristics.


    https://arxiv.org/abs//2410.02735


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • OOD-CHAMELEON: Is Algorithm Selection for OOD Generalization Learnable?



    The paper introduces OOD-CHAMELEON, a method for selecting algorithms for out-of-distribution generalization by predicting performance based on dataset characteristics, outperforming individual algorithms and heuristics.


    https://arxiv.org/abs//2410.02735


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    22 min
  • [QA] Training Language Models on Synthetic Edit Sequences Improves Code Synthesis



    The paper presents LintSeq, a synthetic data generation algorithm that refactors code into edit sequences, improving LLM performance in code synthesis and achieving state-of-the-art results with smaller models.


    https://arxiv.org/abs//2410.02749


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Training Language Models on Synthetic Edit Sequences Improves Code Synthesis



    The paper presents LintSeq, a synthetic data generation algorithm that refactors code into edit sequences, improving LLM performance in code synthesis and achieving state-of-the-art results with smaller models.


    https://arxiv.org/abs//2410.02749


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    19 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,960 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

436 Listeners

The Daily by The New York Times

The Daily

111,708 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,107 Listeners

Hard Fork by The New York Times

Hard Fork

5,564 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

216 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

101 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners