spiderman

spiderman

TurboWay

基于 scrapy-redis 的通用分布式爬虫框架

516 Stars
109 Forks
516 Watchers
Python Language
mit License
Cost to Build
$231.3K
Market Value
$536.7K

Growth over time

6 data points  ·  2021-08-01 → 2023-05-01
Stars Forks Watchers
💬

How do you feel about this project?

Ask AI about spiderman

Question copied to clipboard

What is the TurboWay/spiderman GitHub project? Description: "基于 scrapy-redis 的通用分布式爬虫框架". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone spiderman

Clone via HTTPS

git clone https://github.com/TurboWay/spiderman.git

Clone via SSH

[email protected]:TurboWay/spiderman.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the spiderman issue tracker:

Open GitHub Issues