3 Forks
12 Stars
12 Watchers

crawlerUtils

Utils for programming web crawler

How to download and setup crawlerUtils

Open terminal and run command
git clone https://github.com/Tyrone-Zhao/crawlerUtils.git
git clone is used to create a copy or clone of crawlerUtils repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with crawlerUtils https://github.com/Tyrone-Zhao/crawlerUtils/archive/master.zip

Or simply clone crawlerUtils with SSH
[email protected]:Tyrone-Zhao/crawlerUtils.git

If you have some problems with crawlerUtils

You may open issue on crawlerUtils support forum (system) here: https://github.com/Tyrone-Zhao/crawlerUtils/issues

Similar to crawlerUtils repositories

Here you may see crawlerUtils alternatives and analogs

 requests    scrapy    requests-html    MechanicalSoup    php-curl-class    cpr    requestium    Just    grequests    performance-bookmarklet    uplink    lassie    requests-respectful    httmock    curl    pycookiecheat    node-request-retry    curequests    khttp    Sasila    requests-threads    robotframework-requests    Requester    ngx-resource    AutoLine    human_curl    webspider    saber    asks    assent