Sitemap Generator
Featured
Generate a sitemap.xml from a list of URLs.
- On your device
- No signup
SEO & Webmaster topic guide
Crawl and index tools
Sitemaps, robots.txt, and link checkers—free crawlability tools on your device.
5 free tools in this guide — pick one below to get started.
Tools in this guide(5)
Open a tool to calculate, convert, or edit — no signup required.
Sitemap Validator
Featured
Validate sitemap.xml structure and URLs.
- On your device
- No signup
Robots.txt Generator
Featured
Generate a robots.txt file for your site.
- On your device
- No signup
Robots.txt Tester
Featured
Test whether a URL is allowed in robots.txt.
- On your device
- No signup
Broken Link Checker
Featured
Find broken links on a page from extracted URLs.
- On your device
- No signup
Overview
Crawl tools build discovery files and catch broken links before search engines waste crawl budget. This topic guide groups Utilnivo tools so you can move from rough estimates to a concrete next step without hunting across categories.
Start with the tool that matches your immediate question—sitemap generator, sitemap validator, robots txt generator, robots txt tester, broken link checker—then open related tools, workflows, or long-tail pages when you need comparisons, exports, or follow-up checks.
Outputs are educational. Confirm numbers with professionals, instructors, or platform requirements before you sign, submit, or publish.
How to choose
- Sitemap Generator → sitemap-generator.
- Sitemap Validator → sitemap-validator.
- Robots Txt Generator → robots-txt-generator.
- Robots Txt Tester → robots-txt-tester.
- Broken Link Checker → broken-link-checker.
Frequently asked questions
Who is Crawl and index tools for?
Site owners launching new domains or migrating URLs. Start with sitemap generator, sitemap validator, robots txt generator, then open related topic guides when your task spans multiple steps.
Which tool should I use first in Crawl and index tools?
Use the how-to-choose list on this page—it maps common tasks to specific tools. Crawl tools build discovery files and catch broken links before search engines waste crawl budget.
Are these tools free?
Yes. Utilnivo tools are free for standard browser use with no account required.
Is my data stored online?
Calculations and file processing for standard tools run on your device unless a page explicitly performs a network lookup.
Step-by-step workflows (2)
Multi-step guides that chain tools from this topic—follow numbered steps instead of guessing tool order.