Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • [QA] RLHF Workflow: From Reward Modeling to Online RLHF



    The paper introduces Online Iterative Reinforcement Learning from Human Feedback (RLHF) workflow, achieving superior performance in large language models using open-source datasets and proxy human feedback.


    https://arxiv.org/abs//2405.07863


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    8 min
  • RLHF Workflow: From Reward Modeling to Online RLHF



    The paper introduces Online Iterative Reinforcement Learning from Human Feedback (RLHF) workflow, achieving superior performance in large language models using open-source datasets and proxy human feedback.


    https://arxiv.org/abs//2405.07863


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    22 min
  • [QA] SUTRA: Scalable Multilingual Language Model Architecture



    SUTRA is a multilingual Large Language Model that outperforms existing models, offering efficient and accurate text generation in over 50 languages, with potential global impact on AI accessibility.


    https://arxiv.org/abs//2405.06694


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    10 min
  • [QA] Memory Mosaics



    Memory mosaics are associative memory networks with compositional and in-context learning abilities, outperforming transformers in transparency and language modeling tasks.


    https://arxiv.org/abs//2405.06394


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • Memory Mosaics



    Memory mosaics are associative memory networks with compositional and in-context learning abilities, outperforming transformers in transparency and language modeling tasks.


    https://arxiv.org/abs//2405.06394


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    16 min
  • [QA] Linearizing Large Language Models



    Linear transformers offer a subquadratic-time alternative to softmax attention, but face scaling issues. SUPRA proposes uptraining existing large transformers into RNNs for cost-effective performance.


    https://arxiv.org/abs//2405.06640


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    11 min
  • Linearizing Large Language Models



    Linear transformers offer a subquadratic-time alternative to softmax attention, but face scaling issues. SUPRA proposes uptraining existing large transformers into RNNs for cost-effective performance.


    https://arxiv.org/abs//2405.06640


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    14 min
  • [QA] From LLMs to Actions: Latent Codes as Bridges in Hierarchical Robot Control



    Hierarchical control in robotics faces challenges with language interfaces. Learnable Latent Codes as Bridges (LCB) offer a solution, outperforming language-based baselines on complex tasks in embodied agent benchmarks.


    https://arxiv.org/abs//2405.04798


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    12 min
  • From LLMs to Actions: Latent Codes as Bridges in Hierarchical Robot Control



    Hierarchical control in robotics faces challenges with language interfaces. Learnable Latent Codes as Bridges (LCB) offer a solution, outperforming language-based baselines on complex tasks in embodied agent benchmarks.


    https://arxiv.org/abs//2405.04798


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    14 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,960 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

436 Listeners

The Daily by The New York Times

The Daily

111,708 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,107 Listeners

Hard Fork by The New York Times

Hard Fork

5,564 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

216 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

101 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners