scrapy-requests

rafyzg

Scrapy middleware to handle javascript pages using requests-html

requests crawling

View on GitHub

25 Stars

1 Forks

25 Watchers

Python Language

mit License

Cost to Build

$1.6K

Market Value

$2.0K

How is this calculated?

Growth over time

6 data points · 2022-09-01 → 2025-07-01

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about scrapy-requests

Question copied to clipboard

What is the rafyzg/scrapy-requests GitHub project? Description: "Scrapy middleware to handle javascript pages using requests-html". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone scrapy-requests

Clone via HTTPS

git clone https://github.com/rafyzg/scrapy-requests.git

Clone via SSH

[email protected]:rafyzg/scrapy-requests.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the scrapy-requests issue tracker:

Open GitHub Issues

Similar to scrapy-requests

requests requests-html MechanicalSoup php-curl-class cpr requestium Just grequests performance-bookmarklet uplink lassie requests-respectful httmock curl pycookiecheat node-request-retry curequests khttp Sasila requests-threads robotframework-requests Requester ngx-resource AutoLine human_curl webspider saber asks assent Price-monitor