Arxiv Papers

By Igor MelnykScience

Arxiv Papers episodes

August 21, 2024 Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model

Transfusion is a multi-modal training method combining language modeling and diffusion, achieving superior performance in generating images and text with models up to 7B parameters.

https://arxiv.org/abs//2408.11039

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

25 min
August 20, 2024 [QA] Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models

The paper presents MOHAWK, a method for distilling Transformers into state space models, achieving strong performance with significantly less training data and computational resources.

https://arxiv.org/abs//2408.10189

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

9 min
August 20, 2024 Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models

The paper presents MOHAWK, a method for distilling Transformers into state space models, achieving strong performance with significantly less training data and computational resources.

https://arxiv.org/abs//2408.10189

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

32 min
August 19, 2024 [QA] JPEG-LM: LLMs as Image Generators with Canonical Codec Representations

This paper proposes using canonical codecs for image and video generation in autoregressive models, demonstrating improved efficiency and effectiveness over traditional pixel-based and vector quantization methods.

https://arxiv.org/abs//2408.08459

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

8 min
August 19, 2024 JPEG-LM: LLMs as Image Generators with Canonical Codec Representations

This paper proposes using canonical codecs for image and video generation in autoregressive models, demonstrating improved efficiency and effectiveness over traditional pixel-based and vector quantization methods.

https://arxiv.org/abs//2408.08459

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

21 min
August 19, 2024 [QA] TextCAVs: Debugging vision models using text

TextCAVs is a novel method for generating concept activation vectors using text descriptions, reducing the need for labeled image data in deep learning model interpretability, particularly in medical applications.

https://arxiv.org/abs//2408.08652

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

8 min
August 19, 2024 TextCAVs: Debugging vision models using text

TextCAVs is a novel method for generating concept activation vectors using text descriptions, reducing the need for labeled image data in deep learning model interpretability, particularly in medical applications.

https://arxiv.org/abs//2408.08652

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

10 min
August 18, 2024 [QA] Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers

The paper presents rStar, a self-play mutual reasoning method that enhances small language models' reasoning abilities without fine-tuning, achieving significant accuracy improvements across various reasoning tasks.

https://arxiv.org/abs//2408.06195

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

10 min
August 18, 2024 Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers

The paper presents rStar, a self-play mutual reasoning method that enhances small language models' reasoning abilities without fine-tuning, achieving significant accuracy improvements across various reasoning tasks.

https://arxiv.org/abs//2408.06195

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

17 min
August 17, 2024 [QA] Towards flexible perception with visual memory

https://arxiv.org/abs//2408.08172

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

8 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…