Removing your sitemap won’t stop Google from crawling your site



The source – searchenginejournal.com

Google's John Mueller tells site owners that removing the sitemap will not prevent future URL crawls. This topic is discussed in the latest installment of the Ask Googlebot YouTube video series.

Removing a sitemap from Google Search Console is possible and easy, but if the intent is to stop Googlebot from crawling URLs, site owners will have to use a different solution.

Sitemaps help Google crawl your site faster and more efficiently, but they don't act as an instruction to crawl or not crawl URLs. In theory, a site can be crawled without a sitemap at all. To prevent Googlebot from crawling your site or specific URLs on your site, you must use the noindex tag in your robots.txt file.

More details – in the video:

Share

Spelling error report

The following text will be sent to our editors: