342 Forks
2362 Stars
2362 Watchers

crawler

An easy to use, powerful crawler implemented in PHP. Can execute Javascript.

How to download and setup crawler

Open terminal and run command
git clone https://github.com/spatie/crawler.git
git clone is used to create a copy or clone of crawler repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with crawler https://github.com/spatie/crawler/archive/master.zip

Or simply clone crawler with SSH
[email protected]:spatie/crawler.git

If you have some problems with crawler

You may open issue on crawler support forum (system) here: https://github.com/spatie/crawler/issues

Similar to crawler repositories

Here you may see crawler alternatives and analogs

 scrapy    laravel    symfony    framework    yii2    cphalcon    awesome-php    CodeIgniter    DesignPatternsPHP    composer    hhvm    PHPMailer    phpunit    phabricator    matomo    swoole-src    grav    Cachet    parsedown    flarum    whoops    cakephp    image    october    PHP-Parser    awesome-cheatsheets    flysystem    easywechat    phpredis    workerman