Most popular scraping repositories and open source projects

PythonForWeb

Python for web bootcamp teaching material

14   6   6  

crawling-scraping-scripts

Collection of brazilian soccer data crawling/scraping scripts.

0   6   6  

get-pornhub-thumbnail

PornHubの動画URLからサムネイルを抽出するツール

6   6   6  

musiload-go

Download songs from any music website

0   6   6  

ep-election-turnout

Collecting voter turnout data for the European Parliament elections

2   6   6  

actor-webdesignernews-scraper

Scraper for www.webdesignernews.com, using Apify.

0   6   6  

Note-Scraper

💎 Scraper for scraping data from https://www.notebooksbilliger.de/

0   6   6  

pubfetcher

A Java command-line tool and library to download and store publication...

1   6   6  

viner

Monitor Amazon Vine queues for new items and display them in a browser...

6   6   6  

InstaData

Instagram Scraping tool without API without user credentials

2   6   6  

raiplay-dl

⏬ Python downloader for the Italian streaming platform RaiPlay

4   6   6  

atmmi-info-api

Node.js webservice that turns the ATM Milano news website in a REST AP...

2   6   6  

unofficial-amazon-search

A simple client for searching Amazon

4   6   6  

tennis-predictor

Big Data application to analyse tennis games and predict future events...

1   6   6  

epl-oracle

Predicting EPL results improving the betting odds.

1   6   6  

stockscrape

Getting stock price data using a python script.

4   6   6  

book-recommendation-system

A project to scrape data and build a recommendation system.

3   6   6  

webradio-to-spotify

Scraping songs playing on various classic rock radios and upload them...

1   6   6  

amazon-wishless

The more and longer wishlists you have, the less you look for buying o...

3   6   6  

Soup

A Pharo implementation of beautiful Soup

6   6   6  

python-scraping-tools

A collection of repeatable methods and concepts appearing in python we...

1   6   6  

google-scholar-scraper

2   6   6  

Iceberg-locations

Current Antarctic large iceberg positions derived from ASCAT and OSCAT...

1   6   6  

socialblade-com-api

Unofficial APIs for socialblade.com website.

4   6   6  

h-manga-downloader

A script for downloading hentai manga/doujin files and storing them in...

2   6   6  

tabroom-API

tournaments.tech's API for scraping tabroom.com

3   6   6  

GoogleNewsScraper

A Python package that scrapes Google News article data while remaining...

4   6   6  

scraping-scripts

A collection of web scraping scripts I've made for collecting images o...

0   6   6  

dart-scraping

DART 다트 공시 서류 입수 가공

4   6   6  

animekisa-api

An unofficial AnimeKisa REST API project (using fastify, cheerio, axio...

2   6   6  

iptv_ro

A simple web API for acquiring media streams from a couple of service...

7   6   6  

OceanMonkey

OceanMonkey is a High-Level Distributed Web Crawling and Web Scraping...

3   6   6  

Projects

In this repository you'll find projects about data science and data en...

0   6   6  

ScreeningMarketData_TSETMC

Scraping selected daily trading data from tsetmc.com (Tehran Stock Exc...

1   6   6  

scrapy_utils

scrapy_utils is configuration template project, Contains the extractio...

2   6   6  

za

Scalable web crawling service

1   6   6  

sih2022-interface

An interface for viewing different problem statements of smart india h...

2   6   6  

pydork

Scraping and listing text and image searches on Google, Bing, DuckDuck...

0   6   6  

AutoTor

Simple package to make requests throughout Tor with circuit renewal.

0   6   6  

Api-scrap

apikey search engine scraping methods

6   6   6  

zenrows-node-sdk

SDK to access ZenRows API directly from Node.js. We handle proxies rot...

1   6   6  

bisCrawler

An Automation Webcrawler for Extracting Central Bankers' Speeches

1   6   6  

rust-scraping

Examples of web scraping in Rust

1   6   6  

lezhin-downloader

Simple requests based manhwa downloader which uses the Lezhin API.

2   6   6  

house-pricing-map

Repository for the "Collecting Data to Map Housing Prices" blogpost wi...

1   6   6  

Linkedin-Job-Postings-Visualization-and-Analysis-Python

This Python script scrapes up to 100 most recent Linkedin job postings...

2   6   6  

laravel-scrapingbee

A PHP Laravel Library for Scrapingbee Web Scraping API

2   6   6  

Pobieranie-anime-z-polskich-stron

Siema, jeślisz szukasz gotowego kodu do pobierania linków do cda, mega...

2   6   6  

croncert-config

configuration and github actions for croncert.ch, a website that shows...

3   6   6  

scrapping-berita-nodejs

Scraping News is a powerful scrapping news indonesia

0   6   6