Most popular crawler repositories and open source projects
Google-Patents-Scraper
Automatically download all PDF files of searching results & their pate...
22 65 65
Pinterest-infinite-crawler
An infinite Pinterest crawler/scraper. Crawl image with inifnite-scrol...
11 64 64
scrapy-distributed
A series of distributed components for Scrapy. Including RabbitMQ-base...
11 59 59
local-api-examples
Easy-to-follow examples in Python, Node.js, and C# for web automation...
17 58 58
slideshare-downloader
Python script to download slideshare pdf. This script able to download...
24 57 57
SearchEngineScrapy
Scrape data from Google.com, Bing.com, Baidu.com, Ask.com, Yahoo.com,...
16 56 56