Sign up to save your podcasts
Or
Share Choice of PEFT Technique in Continual Learning: Prompt Tuning is Not All You Need
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Choice of PEFT Technique in Continual Learning: Prompt Tuning is Not All You Need
Research challenges the use of prompt tuning in Continual Learning (CL) methods, finding it hinders performance. Replacing it with LoRA improves accuracy across benchmarks, emphasizing the need for rigorous ablations.
https://arxiv.org/abs//2406.03216
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
View all episodes
By Igor Melnyk
5
33 ratings
Research challenges the use of prompt tuning in Continual Learning (CL) methods, finding it hinders performance. Replacing it with LoRA improves accuracy across benchmarks, emphasizing the need for rigorous ablations.
https://arxiv.org/abs//2406.03216
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
More shows like Arxiv Papers
View all
Exchanges
953 Listeners
Odd Lots
1,942 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
112,250 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,020 Listeners
Hard Fork
5,522 Listeners
UnHerd with Freddie Sayers
212 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
93 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
472 Listeners