Most popular scraping repositories and open source projects

Pastebin-Scraper

Cross platform Pastebin scraper developed in C# using .Net Core 3.

1   8   8  

Crawling-Book

🧾🔍 끝내주는 크롤링&메크로 스크립트를 작성하는 방법 (with Python)

1   8   8  

scraping-tutorial

code for data scraping Youtube tutorial

2   8   8  

lurte

🌊 Scraping AEMET

2   8   8  

simplified-search-engine

Multithreaded Web Crawler, Scraper, Indexer

2   8   8  

amazon-bot

Bot criado com a finalidade de monitorar as mudanças de preços dos ite...

1   8   8  

Soteria_Proxy-Scraper

Proxy Scraper Using My Blazing Fast Soteria Proxy API

2   8   8  

InstaScraper

:bar_chart: A web scraping CLI tool for Instagram profiles.

5   8   8  

Play-Store-Scraper

Scrapes images and description of apps in google play store

1   8   8  

manaba-scraping

This is a script that scrape assignments which haven't been submitted...

0   8   8  

soup

A command line web scraper that lists Hale and Hearty soups

1   8   8  

news-anaCrawler

Article Dataset Generator for Internet News Sites. Crawls news sites,...

1   8   8  

ScraperImages

Simple Web Images Scraper From Websites!

1   8   8  

arenavision-scraper

Little ArenaVision Scraper to get the sports events

1   7   7  

Results_Fetcher

Facilitates retrieval of large amounts of data from GITAM's results pl...

5   7   7  

IMDBScraping

Scrape Data From IMDB Movie DataBase

0   7   7  

trendulkar

Data Mining and Analysis of Cricketer’s Data

1   7   7  

pattern-grab

🤛🏻 Regular Expression Data Grabber

0   7   7  

PING

Professor INformation Gatherer (PING)

0   7   7  

Shaman.Scraping

A C# library for reading/writing WARC files and scraping websites.

3   7   7  

Pyris

A python application to pull Imgur images from the provided Reddit sub...

2   7   7  

scrapinghub-ruby-example

Simple guide to working with Scrapinghub

0   7   7  

PyCast3

Search for and download your favourite podcasts

0   7   7  

golang-scraping-colly

Exemples de récupération de données non structurées avec le framework...

0   7   7  

ReplacementBot

Powerful School Subsitutions bot for your Discord Server 📅

1   7   7  

nba_scrape

An easy-to-use Python utility to scrape basketball data off stats.nba....

1   7   7  

insta_scrape_insta

>Extract Instagram User Information, Post Information Without Login in...

1   7   7  

intro-to-scraping

An introduction to web and document scraping

0   7   7  

outrunJulesVerne

Personalizing unique travel experiences using data science.

2   7   7  

kaist-today-notice

KAIST 오늘의 공지사항

0   7   7  

bitfinex-scraper

A Bitfinex scraping bot that pulls and saves market data into an Influ...

3   7   7  

Urban-Dict-Bot

A twitter bot written as an integration to Urban Dictionary allowing f...

3   7   7  

leo-bot

📢 디스코드 공식 리오봇 📢

1   7   7  

HG630-Python

Python login script for Huawei HG630 V2 router web interface

2   7   7  

katatachi

A Python framework to build web scraping applications.

1   7   7  

musiload-go

Download songs from any music website

0   7   7  

airbnb-scraper

Web scraper/crawler of Airbnb Brazilians page

0   7   7  

minigun-requests

Web scraping API to outsource tons of GET & xpath to cloud computing

0   7   7  

vaccination_data

COVID19 vaccination data from Cantons of Switzerland and Principality...

1   7   7  

goodreads-scraper

goodreads.com scraper that written in Python with Scrapy framework

1   7   7  

Data-Mining

With data, you can build a kingdom.

3   7   7  

PAAs-from-SERPs

Get People Also Ask (PAA) questions from Google SERPs with Puppeteer (...

1   7   7  

Give-Me-The-Sauce

The easiest way to download that sauce.

1   7   7  

rashifal-api

Unofficial Nepali Rashifal API which extracts horoscope predictions fr...

1   7   7  

tdt-chatbot

A messenger chatbot sends timetable and score scraped from TDTU Studen...

1   7   7  

laravel-soccer-compare

Soccer player management PWA

1   7   7  

librevent

scrape and republish facebook Events

5   7   7  

Scrapster

Scrape images from google for your next ML project.

2   7   7  

crawlify

Simple Concurrent Crawler

0   7   7  

Engine

Owl Engine – The Open Source Web Scraper Engine

0   7   7