spiderman

TurboWay

基于 scrapy-redis 的通用分布式爬虫框架

kafka

View on GitHub

617 Stars

126 Forks

617 Watchers

Python Language

mit License

100 SrcLog Score

Cost to Build

$234.4K

Market Value

$559.3K

How is this calculated?

Growth over time

7 data points · 2021-08-01 → 2026-04-01

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about spiderman

Question copied to clipboard

What is the TurboWay/spiderman GitHub project? Description: "基于 scrapy-redis 的通用分布式爬虫框架". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone spiderman

Clone via HTTPS

git clone https://github.com/TurboWay/spiderman.git

Clone via SSH

[email protected]:TurboWay/spiderman.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the spiderman issue tracker:

Open GitHub Issues

Similar to spiderman

graylog2-server atmosphere technology-talk pipeline jocko cilium gizmo librdkafka thingsboard ksql CAP oryx seldon-server secor alpakka-kafka surging enqueue-dev kafka-rest myth goka syslog-ng kafka-php rsyslog pykafka node-rdkafka karafka kafka-storm-starter schema-registry Nagios-Plugins php-rdkafka