Tools

Technical SEO & crawling

7 tools compared: how each is priced, where it runs, and what to consider instead.

Tool Pricing model Free tier Open source
Botify Enterprise SEO platform combining crawling, log-file analysis, and content-performance data at scale. Quote only No No
Conductor Enterprise SEO and AEO platform pairing keyword and competitive intelligence with content workflows. Quote only No No
JetOctopus Cloud log-file and crawl analysis tool priced per crawl volume, aimed at in-house teams and agencies. Subscription No No
Lumar Enterprise website-optimization crawler, formerly known as DeepCrawl, now covering SEO, QA, and AI search. Quote only No No
Oncrawl Enterprise technical SEO crawler pairing crawl data with log-file analysis for large sites. Quote only No No
Screaming Frog SEO Spider Desktop website crawler sold as a one-off annual licence, widely used for technical SEO audits. Subscription Yes No
Sitebulb Desktop and cloud website crawler known for visual, hint-based technical SEO audit reports. Subscription No No

In the index now