Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • [QA] Self-Exploring Language Models: Active Preference Elicitation for Online Alignment



    Reinforcement Learning from Human Feedback improves Large Language Models alignment with human intentions. SELM optimizes reward models for diverse responses, enhancing exploration efficiency and model performance.


    https://arxiv.org/abs//2405.19332


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • Self-Exploring Language Models: Active Preference Elicitation for Online Alignment



    Reinforcement Learning from Human Feedback improves Large Language Models alignment with human intentions. SELM optimizes reward models for diverse responses, enhancing exploration efficiency and model performance.


    https://arxiv.org/abs//2405.19332


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    16 min
  • [QA] Phased Consistency Model



    The paper introduces the Phased Consistency Model (PCM) to improve text-conditioned image generation in the latent space, outperforming existing models across multiple generation steps.


    https://arxiv.org/abs//2405.18407


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    12 min
  • Phased Consistency Model



    The paper introduces the Phased Consistency Model (PCM) to improve text-conditioned image generation in the latent space, outperforming existing models across multiple generation steps.


    https://arxiv.org/abs//2405.18407


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    12 min
  • [QA] Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations



    Understanding model scaling is crucial for designing effective training setups and architectures. This paper challenges the complexity of cosine schedules, proposing a simpler alternative with predictable scaling behavior and improved performance.


    https://arxiv.org/abs//2405.18392


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations



    Understanding model scaling is crucial for designing effective training setups and architectures. This paper challenges the complexity of cosine schedules, proposing a simpler alternative with predictable scaling behavior and improved performance.


    https://arxiv.org/abs//2405.18392


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    12 min
  • [QA] On the Origin of Llamas: Model Tree Heritage Recovery



    The paper introduces Model Tree Heritage Recovery (MoTHer Recovery) to decode model relationships using weights, reconstructing model hierarchies like Llama 2 and Stable Diffusion.


    https://arxiv.org/abs//2405.18432


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • On the Origin of Llamas: Model Tree Heritage Recovery



    The paper introduces Model Tree Heritage Recovery (MoTHer Recovery) to decode model relationships using weights, reconstructing model hierarchies like Llama 2 and Stable Diffusion.


    https://arxiv.org/abs//2405.18432


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    16 min
  • [QA] Transformers Can Do Arithmetic with the Right Embeddings



    Adding position embeddings to digits in transformers improves performance on arithmetic tasks, enabling solving larger problems and enhancing multi-step reasoning abilities like sorting and multiplication.


    https://arxiv.org/abs//2405.17399


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Transformers Can Do Arithmetic with the Right Embeddings



    Adding position embeddings to digits in transformers improves performance on arithmetic tasks, enabling solving larger problems and enhancing multi-step reasoning abilities like sorting and multiplication.


    https://arxiv.org/abs//2405.17399


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    13 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,960 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

436 Listeners

The Daily by The New York Times

The Daily

111,708 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,107 Listeners

Hard Fork by The New York Times

Hard Fork

5,564 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

216 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

101 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners