Sign up to save your podcasts
Or
Share How To Think About Scraping
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
How To Think About Scraping
This week on my podcast, I read a recent Medium column. “How To Think About Scraping: In privacy and labor fights, copyright is a clumsy tool at best,” about the real risks (and benefits) of web-scraping, and how to formulate policy responses that preserve those benefits while targeting the harms head-on”
Scraping when the scrapee suffers as a result of your scraping is good, actually.
Mario Zechner is an Austrian technologist who used the APIs of large grocery chains to prove that they were colluding to rig prices. Zechner was able to create a corpus of historical price and product data to show how grocers used a raft of deceptive practices to trick people into thinking they were getting a good deal, from shrinkflation to cyclic price changes that were deceptively billed as “discounts.”
At first, Zechner worked alone and in fear of reprisals from the giant corporations whose fraudulent practices — which affected every person in the country — he had revealed.
But eventually, he was able to get the Austrian bureaucrat in charge of enforcing competition rules to publish a report lauding his work. Zechner open-sourced his project and attracted volunteers who started pulling in data from Germany and Slovenia.
MP3
(Image: syvwlch, CC BY 2.0, modified)
View all episodes
By Cory Doctorow
4.8
8989 ratings
This week on my podcast, I read a recent Medium column. “How To Think About Scraping: In privacy and labor fights, copyright is a clumsy tool at best,” about the real risks (and benefits) of web-scraping, and how to formulate policy responses that preserve those benefits while targeting the harms head-on”
Scraping when the scrapee suffers as a result of your scraping is good, actually.
Mario Zechner is an Austrian technologist who used the APIs of large grocery chains to prove that they were colluding to rig prices. Zechner was able to create a corpus of historical price and product data to show how grocers used a raft of deceptive practices to trick people into thinking they were getting a good deal, from shrinkflation to cyclic price changes that were deceptively billed as “discounts.”
At first, Zechner worked alone and in fear of reprisals from the giant corporations whose fraudulent practices — which affected every person in the country — he had revealed.
But eventually, he was able to get the Austrian bureaucrat in charge of enforcing competition rules to publish a report lauding his work. Zechner open-sourced his project and attracted volunteers who started pulling in data from Germany and Slovenia.
MP3
(Image: syvwlch, CC BY 2.0, modified)
More shows like Podcast – Cory Doctorow's craphound.com
View all
99% Invisible
26,242 Listeners
On the Media
9,238 Listeners
The Gray Area with Sean Illing
10,747 Listeners
Upstream
1,858 Listeners
Uncanny Valley | WIRED
507 Listeners
Know Your Enemy
2,082 Listeners
This Machine Kills
215 Listeners
Hard Fork
5,576 Listeners
How to Fix the Internet
124 Listeners
The Ezra Klein Show
16,525 Listeners
Search Engine
4,599 Listeners
Understood: Deepfake Porn Empire
270 Listeners
Better Offline
595 Listeners
Taylor Lorenz’s Power User
313 Listeners
Gloves Off
30 Listeners