Arxiv Papers

Arxiv Papers

By Igor MelnykScience
Download on the App Store

Arxiv Papers episodes

  • Is Programming by Example solved by LLMs?



    Large Language Models (LLMs) show promise in solving Programming-by-Examples (PBE) tasks but require fine-tuning for better performance, especially for out-of-distribution problems.


    https://arxiv.org/abs//2406.08316


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    17 min
  • [QA] Can LLMs Learn by Teaching? A Preliminary Study



    The paper explores whether Language Models can learn by teaching (LbT) like humans, showing promising results in improving models through teaching methods.


    https://arxiv.org/abs//2406.14629


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    10 min
  • Can LLMs Learn by Teaching? A Preliminary Study



    The paper explores whether Language Models can learn by teaching (LbT) like humans, showing promising results in improving models through teaching methods.


    https://arxiv.org/abs//2406.14629


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    19 min
  • [QA] Found in the Middle: Calibrating Positional Attention Bias Improves Long Context Utilization



    Large language models struggle with capturing relevant information in the middle of input due to intrinsic attention bias. Mitigating bias with found-in-the-middle mechanism improves performance and RAG outcomes significantly.


    https://arxiv.org/abs//2406.16008


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    12 min
  • Found in the Middle: Calibrating Positional Attention Bias Improves Long Context Utilization



    Large language models struggle with capturing relevant information in the middle of input due to intrinsic attention bias. Mitigating bias with found-in-the-middle mechanism improves performance and RAG outcomes significantly.


    https://arxiv.org/abs//2406.16008


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    16 min
  • [QA] Computational Life: How Well-formed, Self-replicating Programs Emerge from Simple Interaction



    This paper explores the emergence of self-replicators on computational substrates, showing how they arise through random interactions and self-modification, leading to complex dynamics.


    https://arxiv.org/abs//2406.19108


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    9 min
  • Computational Life: How Well-formed, Self-replicating Programs Emerge from Simple Interaction



    This paper explores the emergence of self-replicators on computational substrates, showing how they arise through random interactions and self-modification, leading to complex dynamics.


    https://arxiv.org/abs//2406.19108


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    22 min
  • [QA] REVISION MATTERS: Generative Design Guided by Revision Edits



    Investigating how human designer revisions benefit a multimodal generative model for layout design, showing expert edits lead to strong design outcomes, emphasizing human guidance for iterative improvement.


    https://arxiv.org/abs//2406.18559


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    10 min
  • REVISION MATTERS: Generative Design Guided by Revision Edits



    Investigating how human designer revisions benefit a multimodal generative model for layout design, showing expert edits lead to strong design outcomes, emphasizing human guidance for iterative improvement.


    https://arxiv.org/abs//2406.18559


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    14 min
  • [QA] The Remarkable Robustness of LLMs: Stages of Inference?



    The study explores Large Language Models' robustness by deleting and swapping layers, finding interventions retain 72-95% accuracy without fine-tuning, with more layers showing increased robustness.


    https://arxiv.org/abs//2406.19384


    YouTube: https://www.youtube.com/@ArxivPapers


    TikTok: https://www.tiktok.com/@arxiv_papers


    Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016


    Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers


    10 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

968 Listeners

Odd Lots by Bloomberg

Odd Lots

1,960 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

436 Listeners

The Daily by The New York Times

The Daily

111,708 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,107 Listeners

Hard Fork by The New York Times

Hard Fork

5,564 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

216 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by Latent.Space

Latent Space: The AI Engineer Podcast

101 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

477 Listeners