Sign up to save your podcasts
Or
Share The past, present, and future of robots.txt
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
The past, present, and future of robots.txt
In this episode of Search Off the Record, Gary, Lizzi, and Martin from the Google Search team are joined by special guest David Price, a Product Counsel for Google. They discuss human initiated crawl requests vs. bot initiated crawl requests, the robots.txt file, and more!
Episode transcript → https://goo.gle/sotr028-transcript
Search Off the Record is a podcast series that takes you behind the scenes of Google Search with the Search Relations team.
View all episodes
By Google
4.2
137137 ratings
In this episode of Search Off the Record, Gary, Lizzi, and Martin from the Google Search team are joined by special guest David Price, a Product Counsel for Google. They discuss human initiated crawl requests vs. bot initiated crawl requests, the robots.txt file, and more!
Episode transcript → https://goo.gle/sotr028-transcript
Search Off the Record is a podcast series that takes you behind the scenes of Google Search with the Search Relations team.
More shows like Search Off the Record
View all
Planet Money
30,666 Listeners
Pivot
9,622 Listeners
Social Media Marketing Podcast
1,442 Listeners
The Digital Marketing Podcast
114 Listeners
Marketing School - Digital Marketing and Online Marketing Tips
1,258 Listeners
Syntax - Tasty Web Development Treats
982 Listeners
The Diary Of A CEO with Steven Bartlett
8,748 Listeners
My First Million
2,654 Listeners
Morning Brew Daily
3,032 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,182 Listeners
No Stupid Questions
3,626 Listeners
A Bit of Optimism
2,209 Listeners
Prof G Markets
1,489 Listeners
AI Explored
94 Listeners
OpenAI Podcast
58 Listeners