Sign up to save your podcasts
Or
Share [QA] Is DPO Superior to PPO for LLM Alignment? A Comprehensive Study
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
[QA] Is DPO Superior to PPO for LLM Alignment? A Comprehensive Study
The paper compares Direct Preference Optimization (DPO) and Proximal Policy Optimization (PPO) in aligning large language models with human feedback, showing PPO outperforms DPO in various RLHF testbeds.
https://arxiv.org/abs//2404.10719
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
View all episodes
By Igor Melnyk
5
33 ratings
The paper compares Direct Preference Optimization (DPO) and Proximal Policy Optimization (PPO) in aligning large language models with human feedback, showing PPO outperforms DPO in various RLHF testbeds.
https://arxiv.org/abs//2404.10719
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
More shows like Arxiv Papers
View all
Exchanges
956 Listeners
Odd Lots
1,940 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
437 Listeners
The Daily
112,031 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
9,968 Listeners
Hard Fork
5,510 Listeners
UnHerd with Freddie Sayers
211 Listeners
Unsupervised Learning with Jacob Effron
49 Listeners
Latent Space: The AI Engineer Podcast
92 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
472 Listeners