brightonSEO's podcast

François Goube - The best kept secrets from Robots.txt

10.16.2019 - By Kelvin NewmanPlay

Download our free app to listen on your phone

Download on the App StoreGet it on Google Play

Explore all the ways search engines are exploiting your robots.txt. I will help you understand how Google is using the robots.txt file to understand your website. Spam detection, optimizing crawl budget, prioritizing crawling queues, we will dive into the most strategic use cases to how to leverage the use of robots.txt.

More episodes from brightonSEO's podcast