645 Forks
4651 Stars
4651 Watchers

crawlab

Distributed web crawler admin platform for spiders management regardless of languages and frameworks.

How to download and setup crawlab

Open terminal and run command
git clone https://github.com/crawlab-team/crawlab.git
git clone is used to create a copy or clone of crawlab repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with crawlab https://github.com/crawlab-team/crawlab/archive/master.zip

Or simply clone crawlab with SSH
[email protected]:crawlab-team/crawlab.git

If you have some problems with crawlab

You may open issue on crawlab support forum (system) here: https://github.com/crawlab-team/crawlab/issues