Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [short] Do Transformer World Models Give Better Policy Gradients?
The paper introduces Actions World Models (AWMs) to improve gradient propagation in reinforcement learning, showing that AWMs outperform transformer world models in generating better policies for long-horizon tasks.
https://arxiv.org/abs//2402.05290
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - Do Transformer World Models Give Better Policy Gradients?
The paper introduces Actions World Models (AWMs) to improve gradient propagation in reinforcement learning, showing that AWMs outperform transformer world models in generating better policies for long-horizon tasks.
https://arxiv.org/abs//2402.05290
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
18 min - Lifelong Benchmarks: Efficient Model Evaluation in an Era of Rapid Progress
The paper introduces Lifelong Benchmarks to combat overfitting in machine learning by creating large-scale benchmarks and an efficient evaluation framework, reducing compute cost significantly.
https://arxiv.org/abs//2402.19472
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
2 min - Lifelong Benchmarks: Efficient Model Evaluation in an Era of Rapid Progress
The paper introduces Lifelong Benchmarks to combat overfitting in machine learning by creating large-scale benchmarks and an efficient evaluation framework, reducing compute cost significantly.
https://arxiv.org/abs//2402.19472
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
46 min - [short] Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates
Paper discusses risks of unsafe behaviors in LLMs due to fine-tuning, proposes PTST principle to preserve safety alignment, and shows effectiveness through experiments on various chat models.
https://arxiv.org/abs//2402.18540
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates
Paper discusses risks of unsafe behaviors in LLMs due to fine-tuning, proposes PTST principle to preserve safety alignment, and shows effectiveness through experiments on various chat models.
https://arxiv.org/abs//2402.18540
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
17 min - [short] Approaching Human-Level Forecasting with Language Models
Study explores if language models can forecast like human experts. Developed system aggregates predictions from competitive forecasters, showing promise for accurate large-scale forecasting.
https://arxiv.org/abs//2402.18563
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - Approaching Human-Level Forecasting with Language Models
Study explores if language models can forecast like human experts. Developed system aggregates predictions from competitive forecasters, showing promise for accurate large-scale forecasting.
https://arxiv.org/abs//2402.18563
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
24 min - [short] Massive Activations in Large Language Models
Large Language Models exhibit massive activations with values significantly larger than others, remaining constant across inputs, influencing attention probabilities, and serving as bias terms. Similar phenomena are observed in Vision Transformers.
https://arxiv.org/abs//2402.17762
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - Massive Activations in Large Language Models
Large Language Models exhibit massive activations with values significantly larger than others, remaining constant across inputs, influencing attention probabilities, and serving as bias terms. Similar phenomena are observed in Vision Transformers.
https://arxiv.org/abs//2402.17762
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
21 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,960 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,708 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,107 Listeners
Hard Fork
5,564 Listeners
UnHerd with Freddie Sayers
216 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
101 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners