
Sign up to save your podcasts
Or


Common Crawl, a nonprofit web archive, is facing backlash from publishers, including Danish media outlets, over its role in AI training data. The publishers are demanding that Common Crawl remove copies of their articles from past data sets and stop crawling their websites. Common Crawl plans to comply, citing its inability to engage in costly legal battles. This controversy has significant implications for academic research, which heavily relies on Common Crawl's data sets, and raises concerns about the future of innovation in the AI field.
By Dr. Tony Hoang4.6
99 ratings
Common Crawl, a nonprofit web archive, is facing backlash from publishers, including Danish media outlets, over its role in AI training data. The publishers are demanding that Common Crawl remove copies of their articles from past data sets and stop crawling their websites. Common Crawl plans to comply, citing its inability to engage in costly legal battles. This controversy has significant implications for academic research, which heavily relies on Common Crawl's data sets, and raises concerns about the future of innovation in the AI field.

204 Listeners

3,298 Listeners