A practical crawl loop
Start with the pages. Finish with the sitemap.
Sitemap Frog is built for the part after discovery, when you need to understand what was found and make a defensible export.
- 01
Crawl with boundaries
Choose the site, scope, depth, rate limits, robots behavior, and what to collect.
- 02
Review the evidence
Search and filter records, inspect metadata, audit findings, links, canonicals, redirects, and exclusions.
- 03
Export what belongs
Generate XML, text, CSV, HTML, JSON backups, reports, or a workbook from your curated URL list.
Built for inspection
One crawl, a clear record of the site.
Links, sitemaps, feeds, framework data, rendered pages, media, and HTTP relations.
Technical findings with evidence, consequences, and fixes alongside every affected page.
Include, exclude, compare, re-run analysis, and set sitemap fields at the level that makes sense.
Privacy and responsible use
Clear controls for every crawl.
Use Sitemap Frog only on sites you own, administer, or are authorized to crawl. Cookies are omitted by default. Optional external integrations clearly state when selected URLs and your credentials are sent to Google or Moz.
- 01 Crawl records are stored locally in the browser.
- 02 Robots.txt and conservative rate settings are enabled by default.
- 03 Exported backups and presets redact API credentials.