Crawlie

requests

Python based web crawler/ web scraper with a beautiful GUI.

How to download and setup Crawlie

Open terminal and run command

git clone https://github.com/AyushAjay14/Crawlie.git

git clone is used to create a copy or clone of Crawlie repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with Crawlie https://github.com/AyushAjay14/Crawlie/archive/master.zip

Or simply clone Crawlie with SSH

[email protected]:AyushAjay14/Crawlie.git

If you have some problems with Crawlie

You may open issue on Crawlie support forum (system) here: https://github.com/AyushAjay14/Crawlie/issues

Similar to Crawlie repositories

Here you may see Crawlie alternatives and analogs

requests requests-html MechanicalSoup php-curl-class cpr requestium Just grequests performance-bookmarklet uplink lassie requests-respectful httmock curl pycookiecheat node-request-retry curequests khttp Sasila requests-threads robotframework-requests Requester ngx-resource AutoLine human_curl webspider saber asks assent Price-monitor