Tools / Robots & sitemap

Robots.txt & sitemap validator

Check whether crawlers can reach robots.txt and a sitemap, and review common directive and XML markers.

What it checks

robots.txt response status, user-agent groups, sitemap declarations, and unfamiliar directives.
Declared sitemap (or the conventional /sitemap.xml) response status, XML root marker, and <loc> entry count.

This does not crawl every listed URL or determine whether a search engine will index a page. External-host sitemaps are identified but not fetched.