open-seo-crawler
puneetindersingh
Free SEO crawler, website audit and AI crawler checker. Self-hosted and open source: crawls a site for technical SEO issues and checks that Googlebot, Bingbot and AI crawlers (GPTBot, PerplexityBot, OAI-SearchBot) get the same readable page. CMS-aware, XLSX export, free Screaming Frog alternative.
Growth over time
3 data points · 2026-09-05 → 2026-10-24How do you feel about this project?
Ask AI about open-seo-crawler
Question copied to clipboardWhat is the puneetindersingh/open-seo-crawler GitHub project? Description: "Free SEO crawler, website audit and AI crawler checker. Self-hosted and open source: crawls a site for technical SEO issues and checks that Googlebot, Bingbot and AI crawlers (GPTBot, PerplexityBot, OAI-SearchBot) get the same readable page. CMS-aware, XLSX export, free Screaming Frog alternative.". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
🏆 Show off this rank
Add it to a GitHub README or profile — the card updates as the ranking changes:
How to clone open-seo-crawler
Clone via HTTPS
Clone via SSH
Download ZIP
Download master.zipFound an issue?
Report bugs or request features on the open-seo-crawler issue tracker:
Open GitHub Issues