crawlie

crawlie

spronta

Fast, free, open-source technical SEO + GEO crawler: built for humans and agents.

97 Stars
11 Forks
2 Watchers
Rust Language
other License
100 SrcLog Score
Cost to Build
$830.8K
Market Value
$2.24M

Growth over time

2 data points  ·  2026-07-25 → 2026-08-09
Stars Forks Watchers
💬

How do you feel about this project?

Ask AI about crawlie

Question copied to clipboard

What is the spronta/crawlie GitHub project? Description: "Fast, free, open-source technical SEO + GEO crawler: built for humans and agents.". Written in Rust. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone crawlie

Clone via HTTPS

git clone https://github.com/spronta/crawlie.git

Clone via SSH

[email protected]:spronta/crawlie.git

Download ZIP

Download main.zip

Found an issue?

Report bugs or request features on the crawlie issue tracker:

Open GitHub Issues