flink-crawler
ScaleUnlimited
Continuous scalable web crawler built on top of Flink and crawler-commons
52
Stars
18
Forks
52
Watchers
Java
Language
apache-2.0
License
Growth over time
11 data points · 2021-08-01 → 2025-07-01
Stars
Forks
Watchers
💬
How do you feel about this project?
Ask AI about flink-crawler
Question copied to clipboardWhat is the ScaleUnlimited/flink-crawler GitHub project? Description: "Continuous scalable web crawler built on top of Flink and crawler-commons". Written in Java. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
How to clone flink-crawler
Clone via HTTPS
git clone https://github.com/ScaleUnlimited/flink-crawler.git
Clone via SSH
[email protected]:ScaleUnlimited/flink-crawler.git
Download ZIP
Download master.zipFound an issue?
Report bugs or request features on the flink-crawler issue tracker:
Open GitHub Issues