18 Forks
51 Stars
51 Watchers

crawler-userscript

一个基于 Tampermonkey 插件平台开发的爬虫。主要目的是最大限度模拟用户环境,避免被反爬虫系统识破。

How to download and setup crawler-userscript

Open terminal and run command
git clone https://github.com/zjh1943/crawler-userscript.git
git clone is used to create a copy or clone of crawler-userscript repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with crawler-userscript https://github.com/zjh1943/crawler-userscript/archive/master.zip

Or simply clone crawler-userscript with SSH
[email protected]:zjh1943/crawler-userscript.git

If you have some problems with crawler-userscript

You may open issue on crawler-userscript support forum (system) here: https://github.com/zjh1943/crawler-userscript/issues

Similar to crawler-userscript repositories

Here you may see crawler-userscript alternatives and analogs

 scrapy    Sasila    Price-monitor    webmagic    colly    headless-chrome-crawler    Lulu    newcrawler    scrapple    goose-parser    arachnid    gopa    scrapy-zyte-smartproxy    node-crawler    arachni    newspaper    webster    spidy    N2H4    easy-scraping-tutorial    antch    pomp    talospider    podcastcrawler    FileMasta    lux    scrapy-redis    haipproxy    DotnetSpider    TumblThree