31 Forks
163 Stars
163 Watchers

yispider

一款分布式爬虫平台,帮助你更好的管理和开发爬虫。 内置一套爬虫定义规则(模版),可使用模版快速定义爬虫,也可当作框架手动开发爬虫。(兴趣使然的项目,用的不爽了就更新)

How to download and setup yispider

Open terminal and run command
git clone https://github.com/2young2simple/yispider.git
git clone is used to create a copy or clone of yispider repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with yispider https://github.com/2young2simple/yispider/archive/master.zip

Or simply clone yispider with SSH
[email protected]:2young2simple/yispider.git

If you have some problems with yispider

You may open issue on yispider support forum (system) here: https://github.com/2young2simple/yispider/issues

Similar to yispider repositories

Here you may see yispider alternatives and analogs

 scrapy    Sasila    Price-monitor    webmagic    colly    headless-chrome-crawler    Lulu    newcrawler    scrapple    goose-parser    arachnid    gopa    scrapy-zyte-smartproxy    node-crawler    arachni    newspaper    webster    spidy    N2H4    easy-scraping-tutorial    antch    pomp    talospider    podcastcrawler    FileMasta    lux    scrapy-redis    haipproxy    DotnetSpider    TumblThree