Most popular scraping repositories and open source projects

kenya-news-scrapper

It scrapes various kenyan news sites and returns top news from each an...

9   22   22  

master-to-pythonista

A list of awesome beginners-friendly projects.

20   22   22  

Realestate

Contains a set of Python scripts for real estate data analysis, visual...

12   22   22  

web-ctf-help

Collection of scripts to help with web based ctfs.

3   22   22  

Justdial-Scraper

JustDial Scraper to scrap all the requested data which includes their...

14   22   22  

udemyscraper

A Udemy Course Scraper built with bs4 and selenium, that fetches udemy...

11   22   22  

infotennis

Python for scraping and processing tennis match data from the ATP Tour...

2   22   22  

mlscraper-rust

Scrape structured data from HTML documents automatically

0   22   22  

crawlbase-python

Fast python library for the Crawlbase API

2   22   22  

everand-downloader

This is everand book downloader

2   22   22  

ai_papers_scrapper

Download papers pdfs and other info from main AI conferences

2   21   21  

TweetScraperR

Este paquete proporciona funciones para extraer datos de X/Twitter, in...

0   21   21  

bard-unofficial-api

Google's Bard ChatBot Unofficial NodeJS API

7   21   21  

memes-api

API for scrapping common 🇵🇱 meme sites

8   21   21  

DeCryPt

Scrapes: [HTTP, HTTPS, SOCKS4, and SOCKS5] || "Bypasses" and scrapes p...

10   21   21  

MacroTrends-Scraping

Web scraping and managing data from MacroTrends

8   21   21  

m3u-audiobooks

collection of 100k+ audio books, radio porgrams, music etc from archiv...

4   21   21  

crawling-framework

Easily crawl news portals or blog sites using Storm Crawler.

4   21   21  

exoskeleton

A Python framework to build polite, but tenacious crawlers / scrapers...

1   21   21  

node-github-trend

node.js library for scraping GitHub trending repositories.

3   21   21  

nintendo-games-ratings

Dataset and visualizations of Nintendo Games and ratings, scraped from...

6   21   21  

proxycrawl-php

ProxyCrawl PHP library for scraping and crawling websites

5   21   21  

price_tracker

Price Tracker app for Android and iOS. Built with Flutter

4   21   21  

jwscraper

A python library for scraping videos from JW Player

8   21   21  

qddate

Quick and dirty date parsing Python library to parse HTML dates really...

2   21   21  

product-integrations

Code examples and general information

10   21   21  

reason-rust-scraper

🦀 Scraping & crawling websites using Rust, and ReasonML

1   20   20  

darwin

Projet pour générer la page http://clementgrimal.fr/darwin/

7   20   20  

chesf

CHeSF is the Chrome Headless Scraping Framework, a very very alpha cod...

2   20   20  

Justdail-scrapper

A 100% working Justdial scrapper, Just enter the url and it'll extract...

20   20   20  

fbspider

Scraping Facebook information

7   20   20  

web-clipper

Easily download the main content of a web page in html, markdown, and/...

0   20   20  

ptt-crawler

ptt-crawler is a web crawler module designed to scarpe data from Ptt.

10   20   20  

CLIs-Applications

CLI INTERACTIVE + WORKER + CONCURRENCY + SCRAPING

1   20   20  

LeadGen

This program uses a GoLang Google Maps Scraper to scrape Google Maps f...

5   20   20  

NFT-Dataset

Includes data about over 250 NFT Collections

3   20   20  

Fuelprices_DK

Scraping of 5 types of fuel :fuelpump: from 8 different fuelcompanies...

11   20   20  

scraper-instagram

Scrape data from Instagram without applying for the authenticated API...

4   20   20  

zona-prop-scraper

Scraper de Zonaprop

12   20   20  

path-finder-rl

Method For Establishing Database For Global Value Chain For Parts Proc...

14   20   20  

cw-wizard

Cardmarket Wantlist Wizard 🧙🏼‍♂️🪄 Easily find the sellers with the...

5   19   19  

letterboxd-justwatch

Scans your Letterboxd watchlist and shows you where you can watch thos...

3   19   19  

scrapyteer

Web crawling & scraping framework for Node.js on top of headless Chrom...

0   19   19  

scrapher

A web scraper for PHP to easily extract data from web pages

13   19   19  

dust

Archive web pages with all relevant assets or save as a single file HT...

0   19   19  

scrapy-fieldstats

A Scrapy extension to log items coverage when the spider shuts down

4   19   19  

Tweets-Scrapper

Get all the tweets from your favorite twitter accounts.

6   19   19  

google-search-results-php

Scrape and parse Google search results in PHP

8   19   19  

dzone-refcardz-downloader

Downloads all refcardz from https://dzone.com/refcardz

4   19   19  

PyCarGr

PyCarGr - Unofficial car.gr API

15   19   19