Live checkFree, no sign-up

Sitemap URL Extractor

Collect the addresses in a sitemap into one list, filter them and download as TXT or CSV.

rabbitclip · Tool

Tool

This tool takes a domain or a direct sitemap address and gathers the page addresses in the sitemap into a single list. With a domain, the Sitemap: lines in robots.txt are read first and /sitemap.xml is tried if there are none; if the address is a sitemap index, the child files are read in order. For each entry the loc, lastmod, changefreq and priority fields are parsed; XML entities and namespace prefixes are resolved, and entries that can be recovered from files with missing closing tags or cut-off content still make it into the list, with the problem shown as a note on the file card.

The summary boxes show the total number of addresses, the number of files read, entries without a lastmod, addresses that appear more than once, and entries pointing outside the sitemap's own domain; the path groups summarise how the addresses are spread across the first path segment. The list can be narrowed with a text filter, copied as addresses only, one per line, or downloaded as CSV with loc, lastmod, changefreq and priority columns. This output is useful for taking inventory before a site migration, preparing a redirect table, seeing how a competitor's site is structured, or feeding a broken link check.

The tool reads at most 10 sitemap files, takes the first 1.5 MB of each and lists at most 5,000 addresses; the counts cover every entry read, and the listed portion is stated separately. Compressed (.gz) files are unpacked; files whose unpacked content exceeds 8 MB are marked as errors in the file list. Whether the addresses actually load or comply with robots.txt is not checked; use the Robots.txt & Sitemap Checker for that, and the Sitemap Generator to build a new file. Only the address you enter is read, and the result is cached for 10 minutes.

FAQ

Which sitemap files are read?

With a domain, the Sitemap: lines in robots.txt are read, or /sitemap.xml if there are none; with a direct .xml address only that file is read, plus its child files if it is an index. At most 10 files are downloaded in total.

I have more than 5,000 addresses, can I get them all?

The counts cover every entry, but the list and the download files are limited to the first 5,000 addresses. For larger sites, enter the child files of the index one at a time and download each separately.

What counts as a duplicate address?

The same address appearing in more than one file or more than once in the same file; the first occurrence is kept and the rest go to the duplicate counter. The sitemap protocol expects each address to be listed once.

Is the address I enter stored?

Not permanently; if the same address is requested again within a short time, the result is kept in server memory for about 10 minutes for a faster answer, then deleted.

Related articles

Other tools

If you don’t know where to start, that’s fine; you’re in the right place.

Your project might already be clear in your head, or still just an idea. Either works. On a short call we talk through where you are and where you could go, together.

Let’s set up a call
Let’s talk about your project