Current language models often generalize well from easy to hard data, performing as well as models trained on hard data. It may be better to collect and train on easy data rather than hard data, as hard data is noisier and costlier to collect.

https://arxiv.org/abs//2401.06751

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers