Live checkFree, no sign-up

Sitemap Generator

Enter your domain to crawl the site, or paste your address list; download a sitemap.xml file ready to upload.

rabbitclip · Tool

Tool

Type your domain or root address and press Crawl: the tool starts at the home page, follows links on the same site, reads up to 150 pages, writes the addresses it finds into the list below and builds the sitemap straight away. The crawl respects robots.txt; it leaves out pages marked noindex, addresses with a query string (?) and non-HTML files such as PDFs or images, and when a page's canonical tag points to another address it lists that address instead. If the server sends a valid Last-Modified header, that date is written as lastmod. A crawl takes at most 25 seconds and its result is cached for 10 minutes; for sites larger than 150 pages, paste the address list or CSV instead.

The second route is a list you already have: paste addresses line by line or upload a CSV file with address, lastmod, changefreq and priority columns. The tool checks that every address is a full URL and that all lines share the same domain; a mix of http and https, invalid dates and duplicate addresses are flagged separately. The result screen counts how many addresses were accepted, how many were dropped as duplicates and how many were invalid; the crawl summary shows how many pages were read and how many addresses were left out for which reason. Download or copy the output as sitemap.xml; past 50,000 addresses the tool builds a sitemap index with part files on its own.

changefreq and priority are part of the sitemap format, but Google's own documentation says it ignores both fields, so filling them in does not change your rankings. The crawl only sees links present in the HTML; links added by scripts after the page loads, pages visible only after signing in and pages that nothing links to do not make it into the list. Addresses in a pasted list are not tested for whether they actually load; the broken link checker exists for that. A pasted list is processed only in your browser; in crawl mode our server reads only the address you provide and keeps the result in cache for 10 minutes.

FAQ

My site has more than 150 pages, what should I do?

The crawl reads at most 150 pages; when the limit is reached the summary says so and addresses left in the queue are not listed. For larger sites export the addresses from your admin panel, database or existing sitemap file and paste them as a list or CSV; the tool splits lists above 50,000 addresses into parts on its own and builds a sitemap index.

Why is the crawl result incomplete?

There can be several reasons: robots.txt blocks some paths, pages carry noindex, addresses contain a query string (?), links are added by scripts after the page loads, or the 25 second limit ran out. The counts in the summary show how many addresses each reason left out; you can add the missing addresses to the list by hand and create the sitemap again.

Should I fill in changefreq and priority?

They are optional; Google's own documentation states it does not use these two fields as a ranking signal. You may still want to fill them in for other search engines or internal tools.

Is my domain or address list stored anywhere?

A pasted or uploaded list is processed only in your browser and is not sent to our server. In crawl mode our server reads only the address you provide; the result is kept in cache for 10 minutes and then deleted.

Related articles

Other tools

If you don’t know where to start, that’s fine; you’re in the right place.

Your project might already be clear in your head, or still just an idea. Either works. On a short call we talk through where you are and where you could go, together.

Let’s set up a call
Let’s talk about your project