Most popular scraping repositories and open source projects

scraper

All In One API to easily scrape data from any website, without worryin...

3   22   22  

EinsteinBot

🤖 A Discord bot that allows you to access solutions to homework probl...

12   22   22  

puppeteer-table-parser

Scrape and parse HTML tables with the Puppeteer table parser.

3   22   22  

imdb-api

[🚧 WIP] Cross-platform microservice to scrape the IMDb website.

1   22   22  

code4rena-scraper

Scraping Code4rena contest audits reports for stats, fun (and profit ?...

1   22   22  

eCommerce-Scraping-API

eCommerce Scraping API code examples for Python, PHP and Node.js

4   22   22  

timetable-grabber-sit

Timetable Grabber - SIT is a tool that allows you to grab and export y...

4   22   22  

infotennis

Python for scraping and processing tennis match data from the ATP Tour...

2   22   22  

mlscraper-rust

Scrape structured data from HTML documents automatically

0   22   22  

ai_papers_scrapper

Download papers pdfs and other info from main AI conferences

2   21   21  

TweetScraperR

Este paquete proporciona funciones para extraer datos de X/Twitter, in...

0   21   21  

bard-unofficial-api

Google's Bard ChatBot Unofficial NodeJS API

7   21   21  

crawlbase-python

Fast python library for the Crawlbase API

2   21   21  

crawling-framework

Easily crawl news portals or blog sites using Storm Crawler.

4   21   21  

exoskeleton

A Python framework to build polite, but tenacious crawlers / scrapers...

1   21   21  

node-github-trend

node.js library for scraping GitHub trending repositories.

3   21   21  

nintendo-games-ratings

Dataset and visualizations of Nintendo Games and ratings, scraped from...

6   21   21  

proxycrawl-php

ProxyCrawl PHP library for scraping and crawling websites

5   21   21  

price_tracker

Price Tracker app for Android and iOS. Built with Flutter

4   21   21  

jwscraper

A python library for scraping videos from JW Player

8   21   21  

qddate

Quick and dirty date parsing Python library to parse HTML dates really...

2   21   21  

memes-api

API for scrapping common 🇵🇱 meme sites

8   21   21  

DeCryPt

Scrapes: [HTTP, HTTPS, SOCKS4, and SOCKS5] || "Bypasses" and scrapes p...

10   21   21  

MacroTrends-Scraping

Web scraping and managing data from MacroTrends

8   21   21  

m3u-audiobooks

collection of 100k+ audio books, radio porgrams, music etc from archiv...

4   21   21  

NFT-Dataset

Includes data about over 250 NFT Collections

3   20   20  

Fuelprices_DK

Scraping of 5 types of fuel :fuelpump: from 8 different fuelcompanies...

11   20   20  

scraper-instagram

Scrape data from Instagram without applying for the authenticated API...

4   20   20  

zona-prop-scraper

Scraper de Zonaprop

12   20   20  

path-finder-rl

Method For Establishing Database For Global Value Chain For Parts Proc...

15   20   20  

CLIs-Applications

CLI INTERACTIVE + WORKER + CONCURRENCY + SCRAPING

1   20   20  

LeadGen

This program uses a GoLang Google Maps Scraper to scrape Google Maps f...

5   20   20  

reason-rust-scraper

🦀 Scraping & crawling websites using Rust, and ReasonML

1   20   20  

darwin

Projet pour générer la page http://clementgrimal.fr/darwin/

7   20   20  

chesf

CHeSF is the Chrome Headless Scraping Framework, a very very alpha cod...

2   20   20  

Justdail-scrapper

A 100% working Justdial scrapper, Just enter the url and it'll extract...

20   20   20  

fbspider

Scraping Facebook information

7   20   20  

web-clipper

Easily download the main content of a web page in html, markdown, and/...

0   20   20  

ptt-crawler

ptt-crawler is a web crawler module designed to scarpe data from Ptt.

10   20   20  

scrapher

A web scraper for PHP to easily extract data from web pages

13   19   19  

dust

Archive web pages with all relevant assets or save as a single file HT...

0   19   19  

scrapy-fieldstats

A Scrapy extension to log items coverage when the spider shuts down

4   19   19  

Tweets-Scrapper

Get all the tweets from your favorite twitter accounts.

6   19   19  

google-search-results-php

Scrape and parse Google search results in PHP

8   19   19  

dzone-refcardz-downloader

Downloads all refcardz from https://dzone.com/refcardz

4   19   19  

aiohttp-scraper

A robust asynchronous web scraping client using aiohttp.

5   19   19  

webscrapper

Scrap BTC addresses and balances from bitkeys.work

9   19   19  

socials-api

👨‍👩‍👧‍👦 (Rest) API to extract social media profiles from websites...

5   19   19  

cw-wizard

Cardmarket Wantlist Wizard 🧙🏼‍♂️🪄 Easily find the sellers with the...

5   19   19  

letterboxd-justwatch

Scans your Letterboxd watchlist and shows you where you can watch thos...

3   19   19