SEO & Webmaster topic guide
Crawl and index tools
Sitemaps, robots.txt, and link checkers—free crawlability tools in your browser.
Topic guides
Browse focused guides that compare related tools and link to the best starting point for your task.
- Meta tags and previewsGenerate and preview title tags, meta descriptions, Open Graph, and social cards before you publish a page.
- Sitemap and robots.txtBuild XML sitemaps and robots.txt files, then validate syntax before submitting to search engines.
- Schema and structured dataGenerate JSON-LD schema markup and validate structured data before publishing rich results.
- Technical SEO auditCheck redirects, canonical tags, broken links, headings, and HTTP status before or after a site launch.
- Crawl, headers, and performanceInspect HTTP headers, security headers, keyword density, and Core Web Vitals concepts for healthier pages.
- Campaign tracking and URLsBuild UTM campaign links and clean URL slugs for analytics-ready marketing pages.
- Best free SEO toolsBest free SEO tools for meta tags, sitemaps, robots.txt, audits, schema, and campaign URLs—pros, cons, and which Utilnivo tool to use.
- Website SEO audit checkerRun a free website SEO audit: broken links, heading structure, canonical tags, redirects, and HTTP status—browser-based checks before launch.
- SEO launch checklistPre-launch SEO checklist: HTTP headers, meta tags, robots.txt, sitemap.xml, previews, and structured data validation before you go live.
- On-page SEO toolsMeta tags, headings, canonicals, and snippet previews—free on-page SEO checks in your browser.
- Structured data toolsGenerate and validate JSON-LD schema markup—free structured data tools in your browser.
- Crawl and index toolsSitemaps, robots.txt, and link checkers—free crawlability tools in your browser.
- Campaign tracking toolsUTM builders, redirect checkers, and header inspectors—free campaign URL tools in your browser.
- Site performance SEO toolsSecurity headers, Core Web Vitals explainers, and HTTP checks—free technical SEO performance tools.
Tools in this guide
Overview
Crawl tools build discovery files and catch broken links before search engines waste crawl budget. This topic guide groups Utilnivo tools so you can move from rough estimates to a concrete next step without hunting across categories.
Start with the tool that matches your immediate question—sitemap generator, sitemap validator, robots txt generator, robots txt tester, broken link checker—then open related tools when you need comparisons, exports, or follow-up checks.
Outputs are educational. Confirm numbers with professionals, instructors, or platform requirements before you sign, submit, or publish.
How to choose
- Sitemap Generator → sitemap-generator.
- Sitemap Validator → sitemap-validator.
- Robots Txt Generator → robots-txt-generator.
- Robots Txt Tester → robots-txt-tester.
- Broken Link Checker → broken-link-checker.
Frequently asked questions
Who is Crawl and index tools for?
Site owners launching new domains or migrating URLs. Use the how-to-choose list to pick the right tool for your task.
Are these tools free?
Yes. Utilnivo tools are free for standard browser use with no account required.
Is my data stored online?
Calculations and file processing for standard tools run locally in your browser unless a page explicitly performs a network lookup.
Step-by-step workflows (3)
Multi-step guides that chain tools from this topic—follow numbered steps instead of guessing tool order.
- Launch a basic SEO-ready websiteCheck HTTP headers, draft meta tags, robots.txt, and an XML sitemap before you go live.4 steps
- Debug a site before launchCheck DNS, SSL certificates, HTTP headers, and structured data before you go live.5 steps
- Launch a marketing linkBuild UTM links, draft meta tags, preview shares, and size a YouTube thumbnail for video campaigns.6 steps