Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • Adam-mini: Use Fewer Learning Rates To Gain More



    Adam-mini optimizer reduces memory footprint by using average learning rates within parameter blocks, achieving performance comparable to AdamW with significantly less memory.


    https://arxiv.org/abs//2406.16793


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    14 min
  • [QA] Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMs



    SEPs offer a cost-effective method for detecting hallucinations in Large Language Models by approximating semantic entropy from hidden states, improving efficiency and generalization.


    https://arxiv.org/abs//2406.15927


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    12 min
  • Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMs



    SEPs offer a cost-effective method for detecting hallucinations in Large Language Models by approximating semantic entropy from hidden states, improving efficiency and generalization.


    https://arxiv.org/abs//2406.15927


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    15 min
  • [QA] Evaluating Numerical Reasoning in Text-to-Image Models



    Text-to-image models struggle with numerical reasoning tasks, showing limitations in generating exact numbers, understanding quantifiers, zero, and advanced concepts. GECKONUM benchmark is introduced for evaluation.


    https://arxiv.org/abs//2406.14774


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    12 min
  • Evaluating Numerical Reasoning in Text-to-Image Models



    Text-to-image models struggle with numerical reasoning tasks, showing limitations in generating exact numbers, understanding quantifiers, zero, and advanced concepts. GECKONUM benchmark is introduced for evaluation.


    https://arxiv.org/abs//2406.14774


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    14 min
  • [QA] Advantage Alignment Algorithms



    The paper introduces Advantage Alignment, an algorithm for opponent shaping in AI agents to find socially beneficial equilibria efficiently, proving its effectiveness in various social dilemmas.


    https://arxiv.org/abs//2406.14662


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • Advantage Alignment Algorithms



    The paper introduces Advantage Alignment, an algorithm for opponent shaping in AI agents to find socially beneficial equilibria efficiently, proving its effectiveness in various social dilemmas.


    https://arxiv.org/abs//2406.14662


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    12 min
  • [QA] Transcendence: Generative Models Can Outperform The Experts That Train Them



    Generative models can surpass human performance when trained on data generated by humans, demonstrated by a chess-playing transformer model achieving better performance than human players.


    https://arxiv.org/abs//2406.11741


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    10 min
  • Transcendence: Generative Models Can Outperform The Experts That Train Them



    Generative models can surpass human performance when trained on data generated by humans, demonstrated by a chess-playing transformer model achieving better performance than human players.


    https://arxiv.org/abs//2406.11741


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    16 min
  • [QA] Refusal in Language Models Is Mediated by a Single Direction



    Study explores refusal behavior in chat models, identifying a one-dimensional subspace mediating refusal. Proposes a method to disable refusal while preserving other capabilities, highlighting safety fine-tuning limitations.


    https://arxiv.org/abs//2406.11717


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,960 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

436 Listeners

The Daily by The New York Times

The Daily

111,708 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,107 Listeners

Hard Fork by The New York Times

Hard Fork

5,564 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

216 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

101 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners