Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [QA] RL, but don't do anything I wouldn't do
The paper critiques KL regularization in reinforcement learning, showing it fails with Bayesian predictive models, and proposes a new principle to better control advanced RL agent behavior.
https://arxiv.org/abs//2410.06213
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - RL, but don't do anything I wouldn't do
The paper critiques KL regularization in reinforcement learning, showing it fails with Bayesian predictive models, and proposes a new principle to better control advanced RL agent behavior.
https://arxiv.org/abs//2410.06213
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
17 min - [QA] Restructuring Vector Quantization with the Rotation Trick
This paper proposes a method to propagate gradients through VQ-VAEs' vector quantization layer, improving reconstruction metrics, codebook utilization, and quantization error across various training paradigms.
https://arxiv.org/abs//2410.06424
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Restructuring Vector Quantization with the Rotation Trick
This paper proposes a method to propagate gradients through VQ-VAEs' vector quantization layer, improving reconstruction metrics, codebook utilization, and quantization error across various training paradigms.
https://arxiv.org/abs//2410.06424
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
24 min - [QA] EnsemW2S: Can an Ensemble of LLMs be Leveraged to Obtain a Stronger LLM?
This research proposes an innovative ensemble method for weak-to-strong generalization in AI, enhancing LLM performance through collaborative supervision, achieving significant improvements on challenging tasks.
https://arxiv.org/abs//2410.04571
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - EnsemW2S: Can an Ensemble of LLMs be Leveraged to Obtain a Stronger LLM?
This research proposes an innovative ensemble method for weak-to-strong generalization in AI, enhancing LLM performance through collaborative supervision, achieving significant improvements on challenging tasks.
https://arxiv.org/abs//2410.04571
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
19 min - [QA] Density estimation with LLMs: a geometric investigation of in-context learning trajectories
This study explores LLaMA-2's in-context learning for probability density estimation, revealing unique learning trajectories and interpreting its behavior as adaptive kernel density estimation.
https://arxiv.org/abs//2410.05218
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Density estimation with LLMs: a geometric investigation of in-context learning trajectories
This study explores LLaMA-2's in-context learning for probability density estimation, revealing unique learning trajectories and interpreting its behavior as adaptive kernel density estimation.
https://arxiv.org/abs//2410.05218
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
13 min - [QA] Teaching Transformers Modular Arithmetic at Scale
This paper enhances modular addition in machine learning by introducing diverse training data, angular embedding, and a custom loss function, improving performance for cryptographic applications and other modular arithmetic problems.
https://arxiv.org/abs//2410.03569
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Teaching Transformers Modular Arithmetic at Scale
This paper enhances modular addition in machine learning by introducing diverse training data, angular embedding, and a custom loss function, improving performance for cryptographic applications and other modular arithmetic problems.
https://arxiv.org/abs//2410.03569
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
14 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,960 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,708 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,107 Listeners
Hard Fork
5,564 Listeners
UnHerd with Freddie Sayers
216 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
101 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners