AirSpider

distributed crawler

A Fast and Light Python Spider Framework 🕷️

How to download and setup AirSpider

Open terminal and run command

git clone https://github.com/Xunzhuo/AirSpider.git

git clone is used to create a copy or clone of AirSpider repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with AirSpider https://github.com/Xunzhuo/AirSpider/archive/master.zip

Or simply clone AirSpider with SSH

[email protected]:Xunzhuo/AirSpider.git

If you have some problems with AirSpider

You may open issue on AirSpider support forum (system) here: https://github.com/Xunzhuo/AirSpider/issues

Similar to AirSpider repositories

Here you may see AirSpider alternatives and analogs

tensorflow scrapy CNTK diaspora Qix handson-ml Sasila Price-monitor infinit diplomat olric qTox LightGBM h2o-3 catboost distributed tns webmagic colly headless-chrome-crawler scrapy-cluster Lulu newcrawler scrapple goose-parser arachnid gopa scrapy-zyte-smartproxy EvaEngine.js dgraph