← All checks
SEOTypical severity: Low

Robots & Sitemap Scanner

Checks robots.txt, sitemap.xml and whether the homepage is set to noindex, key for Google indexing.

What it checks

This scanner checks your robots.txt file, your sitemap.xml and whether your homepage is marked as noindex. These are the elements that tell Google what it may crawl and index on your site.

Why it matters

If your homepage is set to noindex or your robots.txt blocks the site by mistake, Google simply won't show you in results, no matter how good your content is. A correct sitemap helps all your pages get discovered and indexed faster.

How to fix it

Check that your homepage has no noindex tag and that robots.txt isn't blocking the sections you want to rank. Publish an up-to-date sitemap.xml with all your important URLs and declare it in robots.txt.

Check it on your site

Scan your site free and see if this and 44 other checks pass, with a fix prompt for every issue.

Scan my site free

Related checks