Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • [QA] The Illusion of State in State-Space Models



    State-space models (SSMs) are not more expressive than transformers for state tracking due to limitations in computational complexity, as shown through analysis and experiments.


    https://arxiv.org/abs//2404.08819


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • The Illusion of State in State-Space Models



    State-space models (SSMs) are not more expressive than transformers for state tracking due to limitations in computational complexity, as shown through analysis and experiments.


    https://arxiv.org/abs//2404.08819


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    20 min
  • [QA] Chinchilla Scaling: A replication attempt



    Hoffmann et al. (2022) propose three methods for estimating a compute-optimal scaling law. Replication of their third method reveals inconsistencies and implausibly narrow confidence intervals.


    https://arxiv.org/abs//2404.10102


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • Chinchilla Scaling: A replication attempt



    Hoffmann et al. (2022) propose three methods for estimating a compute-optimal scaling law. Replication of their third method reveals inconsistencies and implausibly narrow confidence intervals.


    https://arxiv.org/abs//2404.10102


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • [QA] From R to Q: Your Language Model is Secretly a Q-Function



    The paper addresses the mismatch between Direct Preference Optimization (DPO) and standard Reinforcement Learning From Human Feedback (RLHF) setups, proposing a token-level approach for improved performance.


    https://arxiv.org/abs//2404.12358


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • From R to Q: Your Language Model is Secretly a Q-Function



    The paper addresses the mismatch between Direct Preference Optimization (DPO) and standard Reinforcement Learning From Human Feedback (RLHF) setups, proposing a token-level approach for improved performance.


    https://arxiv.org/abs//2404.12358


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    16 min
  • [QA] Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing



    ALPHALLM integrates Monte Carlo Tree Search with Large Language Models for self-improvement, enhancing reasoning abilities without additional annotations, addressing challenges in complex tasks.


    https://arxiv.org/abs//2404.12253


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    10 min
  • Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing



    ALPHALLM integrates Monte Carlo Tree Search with Large Language Models for self-improvement, enhancing reasoning abilities without additional annotations, addressing challenges in complex tasks.


    https://arxiv.org/abs//2404.12253


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    23 min
  • [QA] Dynamic Typography: Bringing Text to Life via Video Diffusion Prior



    Automated Dynamic Typography scheme deforms letters to convey meaning and adds vibrant movements based on user prompts, maintaining legibility and coherence in text animations.


    https://arxiv.org/abs//2404.11614


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    12 min
  • Dynamic Typography: Bringing Text to Life via Video Diffusion Prior



    Automated Dynamic Typography scheme deforms letters to convey meaning and adds vibrant movements based on user prompts, maintaining legibility and coherence in text animations.


    https://arxiv.org/abs//2404.11614


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    17 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,960 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

436 Listeners

The Daily by The New York Times

The Daily

111,708 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,107 Listeners

Hard Fork by The New York Times

Hard Fork

5,564 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

216 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

101 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners