Arxiv Papers

By Igor Melnyk

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video... more

· Science

5

33 ratings

Download on the App Store

Download on the App Store

Get it on Google Play

FAQs about Arxiv Papers:

How many episodes does Arxiv Papers have?

The podcast currently has 2,489 episodes available.

Arxiv Papers episodes:

February 13, 2024 [short] A Tale of Tails: Model Collapse as a Change of Scaling Laws
The paper explores how neural scaling laws may change as synthetic data is incorporated into training, potentially leading to model collapse.

https://arxiv.org/abs//2402.07043

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
...more
3min
February 13, 2024 A Tale of Tails: Model Collapse as a Change of Scaling Laws

The paper explores how neural scaling laws may change as synthetic data is incorporated into training, potentially leading to model collapse.

https://arxiv.org/abs//2402.07043

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

...more
25min
February 13, 2024 [short] Scaling Laws for Fine-Grained Mixture of Experts
Analysis of Mixture of Experts (MoE) models' scaling properties introduces a new hyperparameter, granularity, optimizing training configuration for computational efficiency over dense Transformers.

https://arxiv.org/abs//2402.07871

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

...more
3min
February 13, 2024 Scaling Laws for Fine-Grained Mixture of Experts
Analysis of Mixture of Experts (MoE) models' scaling properties introduces a new hyperparameter, granularity, optimizing training configuration for computational efficiency over dense Transformers.

https://arxiv.org/abs//2402.07871

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

...more
20min
February 13, 2024 [short] Suppressing Pink Elephants with Direct Principle Feedback
The paper introduces Direct Principle Feedback for controlling language models at inference time, showcasing improved performance on the Pink Elephant Problem compared to existing methods.

https://arxiv.org/abs//2402.07896

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

...more
3min
February 13, 2024 Suppressing Pink Elephants with Direct Principle Feedback
The paper introduces Direct Principle Feedback for controlling language models at inference time, showcasing improved performance on the Pink Elephant Problem compared to existing methods.

https://arxiv.org/abs//2402.07896

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

...more
17min
February 12, 2024 V-STaR: Training Verifiers for Self-Taught Reasoners
V-STaR leverages correct and incorrect solutions from self-improvement of large language models to train a verifier, improving problem-solving accuracy by 4%-17% on various benchmarks.

https://arxiv.org/abs//2402.06457

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
...more
3min
February 12, 2024 V-STaR: Training Verifiers for Self-Taught Reasoners
V-STaR leverages correct and incorrect solutions from self-improvement of large language models to train a verifier, improving problem-solving accuracy by 4%-17% on various benchmarks.

https://arxiv.org/abs//2402.06457

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
...more
21min
February 12, 2024 [short] Feedback Loops With Language Models Drive In-Context Reward Hacking
Language models interact with the world through APIs, content generation, and system commands, creating feedback loops that can lead to in-context reward hacking. Recommendations for evaluation are provided.

https://arxiv.org/abs//2402.06627

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

...more
3min
February 12, 2024 Feedback Loops With Language Models Drive In-Context Reward Hacking
Language models interact with the world through APIs, content generation, and system commands, creating feedback loops that can lead to in-context reward hacking. Recommendations for evaluation are provided.

https://arxiv.org/abs//2402.06627

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

...more
21min

FAQs about Arxiv Papers:

How many episodes does Arxiv Papers have?

The podcast currently has 2,489 episodes available.

More shows like Arxiv Papers

Exchanges by Goldman Sachs

Exchanges

956 Listeners

Odd Lots by Bloomberg

Odd Lots

1,952 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

437 Listeners

The Daily by The New York Times

The Daily

112,321 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,017 Listeners

Hard Fork by The New York Times

Hard Fork

5,524 Listeners

UnHerd with Freddie Sayers by UnHerd

UnHerd with Freddie Sayers

211 Listeners

Unsupervised Learning with Jacob Effron by by Redpoint Ventures

Unsupervised Learning with Jacob Effron

51 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

93 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

472 Listeners