Guides

Crawl a known set. Measure it. Move on.

• → What list crawling is in SEO A finite URL set, fetched on purpose — not a spider wandering your site, and not Googlebot’s discovery loop.
• → Screaming Frog List mode Upload the list, keep depth at zero, and follow redirects only when a migration demands it.
• → Build a list from GSC, sitemap, and logs Three inventories, one deduplicated set. The gaps between them are the audit.
• → Migration URL audit Old URLs in. Status, hop count, and final destination out. No surprises on launch day.