ES Book a call Menu

FreeNo sign-upReads robots.txt like Google50 pages fetched live

Sitemap checker

Find out whether search engines can use your sitemap, and whether the pages in it are pages they should index. You get a score, the fixes in plain words, and a link you can send to whoever runs your site.

  • Finds the sitemap the way crawlers do: robots.txt first, then the four usual addresses, then every sitemap an index points to.
  • Validates every file against the sitemaps.org rules: 50,000 addresses, 50 MB, the namespace, dates and escaping.
  • Fetches 50 of the listed pages (the first 25 and 25 at random) and reports 404s, redirects, noindex and wrong canonicals.
  • Nothing to install and no account: the report link works for 30 days, and you can delete it.
robots.txt points to a sitemap index, the index to its sitemaps, and each sitemap to pages that answer 200, redirect or are missing. robots.txt sitemapindex 200 ✓301 →404 ✕
What the checker walks: robots.txt, the sitemap index, its sitemaps, and a sample of the pages they list.

How to check a sitemap

The rules a sitemap has to follow

What a sitemap is for, and what it isn't

A sitemap is a list of the pages you want search engines to find, with the date each one last changed. It doesn't make a page rank, and it doesn't force anything into the index: it is a hint that saves crawlers from guessing. That is why the pages in it matter more than the file. A sitemap where 1 address in 10 redirects or answers 404 teaches search engines that your list isn't worth trusting, and they visit it less.

The five problems we see most

Addresses that redirect, usually http:// to https:// or a missing trailing slash after a site move. Pages marked noindex that a plugin still lists. Deleted pages that stay in the sitemap for months. A lastmod date that says every page changed today, which makes search engines ignore all the dates. And a sitemap that exists but isn't named in robots.txt, so only the engines you told by hand ever read it.

How we score

Each problem costs points once: 30 for critical, 10 for an error, 4 for a warning, and nothing for a note. Problems that affect only some addresses cost between 40% and 100% of that, by the share of addresses they hit, so fixing a problem everywhere is what lifts the score. Any critical problem caps the score at 49. A is 90 and up, B 80, C 70, D 55.

Questions

Do I need a sitemap at all?

A small site whose pages all link to each other gets found without one. A sitemap helps when the site is large, new with few links from elsewhere, or has pages that are hard to reach by clicking. It costs nothing, and most site builders make one for you.

Why only 50 pages?

The quick check runs live in about 20 seconds, so it fetches the first 25 pages and 25 picked at random from everything it read. That catches site-wide problems such as redirects or noindex templates. The percentages in the report are from those 50.

Is it the same as what Google sees?

We read robots.txt with Google's rules for Googlebot and follow the same sitemap protocol, but we fetch from our own servers, not Google's. A site that blocks unknown crawlers can show us errors it doesn't show Google. Search Console's Sitemaps report is the final word for Google.

Will this slow my site down?

No. One check is robots.txt, up to 12 sitemap files and 50 page requests, six at a time at most. The same site can be checked 30 times an hour across all users, and we skip any page your robots.txt closes to our crawler.

Who can see my report?

Anyone with its link, which is long and random, for 30 days. Search engines are told not to index it. The browser you ran it in can delete it at once.

What does the score not cover?

Pages that no link reaches, linked pages missing from the sitemap, and addresses listed in two sitemaps. Those need a crawl of the whole site, which we are adding as a free full check.

Related

Get a quote

Leave your name and email, and a phone number or a note if you like. We'll get back to you soon.

Prefer email? Contact@WebLandscapes.com

Book a call

Fifteen minutes, free. Pick a time below; the invitation comes from Google Calendar.

Pick a time

1 Pick a day

Checking the calendar…

Rather talk now? Call +1 786 608 8489 or email Contact@WebLandscapes.com.