DeadPool
Ryuchen
该项目是一个使用celery作为主体框架的爬虫应用，能够灵活的添加爬虫任务，并且同时运行多站点的爬虫工作，所有组件都能够原生支持规模并发和分布式，加上celery原生的分布式调用，实现大规模并发。
38
Stars
15
Forks
38
Watchers
Python
Language
Growth over time
7 data points · 2021-08-01 → 2023-07-01
Stars
Forks
Watchers
💬
How do you feel about this project?
Ask AI about DeadPool
Question copied to clipboardWhat is the Ryuchen/DeadPool GitHub project? Description: "该项目是一个使用celery作为主体框架的爬虫应用，能够灵活的添加爬虫任务，并且同时运行多站点的爬虫工作，所有组件都能够原生支持规模并发和分布式，加上celery原生的分布式调用，实现大规模并发。". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
How to clone DeadPool
Clone via HTTPS
git clone https://github.com/Ryuchen/DeadPool.git
Clone via SSH
[email protected]:Ryuchen/DeadPool.git
Download ZIP
Download master.zipFound an issue?
Report bugs or request features on the DeadPool issue tracker:
Open GitHub Issues