1 Forks
10 Stars
10 Watchers

NCrawler

基于nodejs编写的一套网页数据采集框架,开发者只需要简单编写网页解析器即可完成采集工作

How to download and setup NCrawler

Open terminal and run command
git clone https://github.com/foodmade/NCrawler.git
git clone is used to create a copy or clone of NCrawler repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with NCrawler https://github.com/foodmade/NCrawler/archive/master.zip

Or simply clone NCrawler with SSH
[email protected]:foodmade/NCrawler.git

If you have some problems with NCrawler

You may open issue on NCrawler support forum (system) here: https://github.com/foodmade/NCrawler/issues

Similar to NCrawler repositories

Here you may see NCrawler alternatives and analogs

 scrapy    Sasila    Price-monitor    webmagic    colly    headless-chrome-crawler    Lulu    newcrawler    scrapple    goose-parser    arachnid    gopa    scrapy-zyte-smartproxy    node-crawler    arachni    newspaper    webster    spidy    N2H4    easy-scraping-tutorial    antch    pomp    talospider    podcastcrawler    FileMasta    lux    scrapy-redis    haipproxy    DotnetSpider    TumblThree