Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • Estimating the Hallucination Rate of Generative AI



    The paper introduces a method to estimate hallucination rates in in-context learning with Generative AI, focusing on Bayesian interpretation and empirical evaluations.


    https://arxiv.org/abs//2406.07457


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    15 min
  • [QA] Beyond Model Collapse: Scaling Up with Synthesized Data Requires Reinforcement



    Generative models are used to fine-tune Large Language Models, but model collapse can occur. Feedback on synthesized data can prevent this, as shown in theoretical analysis and practical applications.


    https://arxiv.org/abs//2406.07515


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • Beyond Model Collapse: Scaling Up with Synthesized Data Requires Reinforcement



    Generative models are used to fine-tune Large Language Models, but model collapse can occur. Feedback on synthesized data can prevent this, as shown in theoretical analysis and practical applications.


    https://arxiv.org/abs//2406.07515


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    15 min
  • Attention as a Hypernetwork



    Transformers can generalize to novel compositions by using a low-dimensional latent code in multi-head attention, enhancing compositional generalization on abstract reasoning tasks.


    https://arxiv.org/abs//2406.05816


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    15 min
  • [QA] Distributional Preference Alignment of LLMs via Optimal Transport



    The paper introduces Alignment via Optimal Transport for distributional preference alignment of LLMs, achieving state-of-the-art results on various datasets and LLMs.


    https://arxiv.org/abs//2406.05882


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    11 min
  • Distributional Preference Alignment of LLMs via Optimal Transport



    The paper introduces Alignment via Optimal Transport for distributional preference alignment of LLMs, achieving state-of-the-art results on various datasets and LLMs.


    https://arxiv.org/abs//2406.05882


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    14 min
  • [QA] How Far Can Transformers Reason? The Locality Barrier and Inductive Scratchpad



    The paper explores the learnability of new syllogisms by Transformers, introducing the concept of distribution locality to determine efficient learning, showing limitations in composing syllogisms on long chains.


    https://arxiv.org/abs//2406.06467


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    10 min
  • How Far Can Transformers Reason? The Locality Barrier and Inductive Scratchpad



    The paper explores the learnability of new syllogisms by Transformers, introducing the concept of distribution locality to determine efficient learning, showing limitations in composing syllogisms on long chains.


    https://arxiv.org/abs//2406.06467


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    18 min
  • [QA] Mixture-of-Agents Enhances Large Language Model Capabilities



    The paper introduces a Mixture-of-Agents (MoA) approach to combine strengths of multiple large language models, outperforming GPT-4 Omni on various tasks.


    https://arxiv.org/abs//2406.04692


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    11 min
  • Mixture-of-Agents Enhances Large Language Model Capabilities



    The paper introduces a Mixture-of-Agents (MoA) approach to combine strengths of multiple large language models, outperforming GPT-4 Omni on various tasks.


    https://arxiv.org/abs//2406.04692


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    13 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,960 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

436 Listeners

The Daily by The New York Times

The Daily

111,708 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,107 Listeners

Hard Fork by The New York Times

Hard Fork

5,564 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

216 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

101 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners