Podcast: Search Off the Record (LS 46 · TOP 1% what is this?)
Episode: Crawling smarter, not harder
Pub date: 2024-08-08

Get Podcast Transcript →
powered by Listen411 - fast audio-to-text and summarization

In this episode of SOTR, John Mueller, Lizzi Sassman, and Gary Illyes talk about misconceptions around crawl frequency and site quality, what's challenging about crawling the web nowadays, and how search engines could crawl more efficiently. 

Resources: Episode transcript → https://goo.gle/sotr079-transcript Gary's post on LinkedIn  → https://goo.gle/3YAT55q  Crawling episode with Dave Smart → https://goo.gle/3WShUsf  If-Modified-Since  → https://goo.gle/3ywXvja  About the IETF → https://goo.gle/3SGVVlo  Robots Exclusion Protocol → https://goo.gle/4dgmBSg  Proposal for new kind of chunked transfer  → https://goo.gle/3AgMF1c 

Listen to more Search Off the Record → https://goo.gle/sotr-yt Subscribe to Google Search Channel → https://goo.gle/SearchCentral

Search Off the Record is a podcast series that takes you behind the scenes of Google Search with the Search Relations team.

#SOTRpodcast

The podcast and artwork embedded on this page are from Google, which is the property of its owner and not affiliated with or endorsed by Listen Notes, Inc.