FreeNo sign-upReads robots.txt like Google50 pages fetched live
Sitemap checker
Find out whether search engines can use your sitemap, and whether the pages in it are pages they should index. You get a score, the fixes in plain words, and a link you can send to whoever runs your site.
- Finds the sitemap the way crawlers do: robots.txt first, then the four usual addresses, then every sitemap an index points to.
- Validates every file against the sitemaps.org rules: 50,000 addresses, 50 MB, the namespace, dates and escaping.
- Fetches 50 of the listed pages (the first 25 and 25 at random) and reports 404s, redirects, noindex and wrong canonicals.
- Nothing to install and no account: the report link works for 30 days, and you can delete it.
How to check a sitemap
- Type the site The domain is enough. If you know the sitemap's address, paste that instead and we check it directly.
- Watch it read You see each step as it happens: robots.txt, every sitemap file, then the 50 pages we fetch. Most sites take under 20 seconds.
- Fix the top items Start with "Fix these first". Each item says what is wrong, how many addresses it affects, and what to change.
The rules a sitemap has to follow
| Rule | Limit | Set by |
|---|---|---|
| Addresses in one sitemap file | 50,000 | sitemaps.org |
| Size of one file, uncompressed | 50 MB | sitemaps.org |
| Sitemaps in one index | 50,000 | sitemaps.org |
| Length of one address | 2,048 characters | sitemaps.org |
| Images listed for one page | 1,000 | |
| Articles in a news sitemap | 1,000, from the last 2 days | |
| Video description | 2,048 characters | |
| Video duration | 1 to 28,800 seconds | |
| robots.txt Google reads | 500 KiB | |
| Encoding | UTF-8 | sitemaps.org |
| changefreq, priority | Ignored by Google |
What a sitemap is for, and what it isn't
A sitemap is a list of the pages you want search engines to find, with the date each one last changed. It doesn't make a page rank, and it doesn't force anything into the index: it is a hint that saves crawlers from guessing. That is why the pages in it matter more than the file. A sitemap where 1 address in 10 redirects or answers 404 teaches search engines that your list isn't worth trusting, and they visit it less.
The five problems we see most
Addresses that redirect, usually http:// to https:// or a missing trailing slash after a site move. Pages marked noindex that a plugin still lists. Deleted pages that stay in the sitemap for months. A lastmod date that says every page changed today, which makes search engines ignore all the dates. And a sitemap that exists but isn't named in robots.txt, so only the engines you told by hand ever read it.
How we score
Each problem costs points once: 30 for critical, 10 for an error, 4 for a warning, and nothing for a note. Problems that affect only some addresses cost between 40% and 100% of that, by the share of addresses they hit, so fixing a problem everywhere is what lifts the score. Any critical problem caps the score at 49. A is 90 and up, B 80, C 70, D 55.
Questions
Do I need a sitemap at all?
A small site whose pages all link to each other gets found without one. A sitemap helps when the site is large, new with few links from elsewhere, or has pages that are hard to reach by clicking. It costs nothing, and most site builders make one for you.
Why only 50 pages?
The quick check runs live in about 20 seconds, so it fetches the first 25 pages and 25 picked at random from everything it read. That catches site-wide problems such as redirects or noindex templates. The percentages in the report are from those 50.
Is it the same as what Google sees?
We read robots.txt with Google's rules for Googlebot and follow the same sitemap protocol, but we fetch from our own servers, not Google's. A site that blocks unknown crawlers can show us errors it doesn't show Google. Search Console's Sitemaps report is the final word for Google.
Will this slow my site down?
No. One check is robots.txt, up to 12 sitemap files and 50 page requests, six at a time at most. The same site can be checked 30 times an hour across all users, and we skip any page your robots.txt closes to our crawler.
Who can see my report?
Anyone with its link, which is long and random, for 30 days. Search engines are told not to index it. The browser you ran it in can delete it at once.
What does the score not cover?
Pages that no link reaches, linked pages missing from the sitemap, and addresses listed in two sitemaps. Those need a crawl of the whole site, which we are adding as a free full check.
Related
- Visual sitemap: the same check drawn as a map of the site, with each problem on its page.
- SEO checker: check a page's title, description, canonical and links.
- Website Archive: keep a working offline copy of your site before a redesign.
- About our checker's requests: what it fetches, and how to opt out.
- Web design and SEO fixes: what we do when the report shows work to be done.