spydy

distributed

基于Pipeline的爬虫框架，工作流非常简单、直观，而且支持异步。light-weight high-level web-crawling framework

How to download and setup spydy

Open terminal and run command

git clone https://github.com/superjcd/spydy.git

git clone is used to create a copy or clone of spydy repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with spydy https://github.com/superjcd/spydy/archive/master.zip

Or simply clone spydy with SSH

[email protected]:superjcd/spydy.git

If you have some problems with spydy

You may open issue on spydy support forum (system) here: https://github.com/superjcd/spydy/issues

Similar to spydy repositories

Here you may see spydy alternatives and analogs

tensorflow CNTK diaspora Qix handson-ml infinit diplomat olric qTox LightGBM h2o-3 catboost distributed tns scrapy-cluster EvaEngine.js dgraph redisson cat js-ipfs nile.js orbit-db bit CacheP2P server phoenix micro oklog sandglass xxl-mq