Most popular scraping repositories and open source projects

nextjs_scraping_marketplace

Scraping product from Tokopedia & Bukalapak

2   9   9  

bookmeter-recommender

python3 bookmeter scraping tools

0   9   9  

SiteRank-Alexa

This is vanilla Python library for gathering data about websites and d...

2   9   9  

scrapy-scraperapi-proxy

Scrapy middleware interface to a scraper API proxy service

4   9   9  

USOSweb-automated

A library for automating and extending the capabilities of the USOSweb...

2   9   9  

rrchackathon

Real Rent Control Hackathon - Vancouver - Project

0   9   9  

partisan

An analysis of the partisan behavior for the U.S. House of Representat...

1   9   9  

ign-fr-opendata-download-ui

Scripts d'extraction des liens open data de l'IGN France pour les prés...

1   9   9  

DatingAI

Learning & researching personal taste in online dating, developing a p...

2   9   9  

ImageScraper

Dumps all images from a WebSite.

2   9   9  

amazonpy

Amazon scraping library

3   9   9  

imageboard-dl

Image downloader for various imageboards and image albums written in P...

4   9   9  

quora-loader

A realtime read-only locator and extraction library for Quora question...

0   9   9  

archive-your-ig

Download all instagram image and video post

1   9   9  

Syo

Download web novels from Syosetu

4   9   9  

Wishlist-Scrape

A simple wishlist scrape using python3, re and urllib

4   9   9  

scraping-tutorial

This tutorial explains the benefits, pitfalls, and limitations of scra...

3   9   9  

raiplay-dl

⏬ Python downloader for the Italian streaming platform RaiPlay

3   9   9  

Cancel_Instagram_Follow_Requests

A simple script that automatically gets all the people you have sent a...

8   9   9  

NIST-web-book-scraping

Small algorithm for getting Antoine's coefficient to calculate vapor p...

2   9   9  

bidbybid

💸 Python tool which scrapes sold eBay auctions for minimum, maximum a...

0   9   9  

sadales-tikls-json

Lejuplādē AS "Sadales tīkls" datus JSON formātā.

2   9   9  

webradio-to-spotify

Scraping songs playing on various classic rock radios and upload them...

1   9   9  

News-Article-Scraper

Learn about web scraping news articles using Python and JavaScript.

2   9   9  

vultr-outages

Track Vultr outages via Git History

1   9   9  

ScreeningMarketData_TSETMC

Scraping selected daily trading data from tsetmc.com (Tehran Stock Exc...

2   9   9  

python-automation-and-scraping

Sending Emails with Python

4   9   9  

resume-in

A LinkedIn web scraping to JSON file

0   9   9  

Web_Scraper_Tutor

This repo basically contains details on how to work with WEB SCRAPER a...

0   9   9  

FollowAnalyser

Discover who really is your friend on social media, and get rid of par...

0   9   9  

dm-feeds

An RSS feed for websites with broken or unavailable RSS feeds

0   9   9  

lezhin-downloader

Simple requests based manhwa downloader which uses the Lezhin API.

2   9   9  

GogoAnimeFrontend

Anime Streaming, Discovery API made with Cheerio and Express. Uses dat...

2   9   9  

rug

Library for fetching various stock data from the internet (official an...

0   9   9  

nekopoi-scraper

API scraper for nekopoi.care

3   9   9  

trading212-pie-sync

🍰 Python tool to automate Trading212 pies allocations by syncing to a...

2   9   9  

100-days-of-Code-Python

Daily Projects from the 100 Days of Code - The Complete Python Pro Boo...

2   8   8  

AutoTor

Simple package to make requests throughout Tor with circuit renewal.

1   8   8  

reservoir

Karanataka Reservoir flow details as reported by Karnataka State Natur...

1   8   8  

get-scholar-professors

0   8   8  

house-pricing-map

Repository for the "Collecting Data to Map Housing Prices" blogpost wi...

2   8   8  

born2crawl

A highly performant and versatile crawling engine, designed with scala...

0   8   8  

ncov-api

API cung cấp thông tin, dữ liệu bệnh nhân về COVID-19!

5   8   8  

lekcije

Follow your favorite teachers in DMM Eikaiwa

1   8   8  

puppeteer-print-view

1   8   8  

Bajaj_FinSearch-hackrx2.0

Solution to Bajaj HackRx's problem statment 1 : Website search engine.

0   8   8  

bing-scraper

Mostly helpful when scraping usernames.

0   8   8  

dcurooms

A command line tool used to display room information and book and requ...

0   8   8  

76telecom-search-pppoe

Automatic pPPoE generator for 76Telecom company

0   8   8  

aragog

Distributed web scraping framework

1   8   8