1 Forks
21 Stars
21 Watchers

scrapy-requests

Scrapy middleware to handle javascript pages using requests-html

How to download and setup scrapy-requests

Open terminal and run command
git clone https://github.com/rafyzg/scrapy-requests.git
git clone is used to create a copy or clone of scrapy-requests repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with scrapy-requests https://github.com/rafyzg/scrapy-requests/archive/master.zip

Or simply clone scrapy-requests with SSH
[email protected]:rafyzg/scrapy-requests.git

If you have some problems with scrapy-requests

You may open issue on scrapy-requests support forum (system) here: https://github.com/rafyzg/scrapy-requests/issues

Similar to scrapy-requests repositories

Here you may see scrapy-requests alternatives and analogs

 requests    scrapy    requests-html    MechanicalSoup    php-curl-class    cpr    requestium    Just    grequests    performance-bookmarklet    uplink    lassie    requests-respectful    httmock    curl    pycookiecheat    node-request-retry    curequests    khttp    Sasila    requests-threads    robotframework-requests    Requester    ngx-resource    AutoLine    human_curl    webspider    saber    asks    assent