Most popular scraping repositories and open source projects

MSRIT-Results

Web app for MSRIT results.

2   3   3  

java-webscraping

How to scrape data from a website using java

3   3   3  

Quora

1   3   3  

GutenbergScrapper

This repo contains a scrapper for the Gutenberg's project website whic...

2   3   3  

kromium

Kromium is Chrome automation library written in Kotlin

0   3   3  

Websec

Websec

2   3   3  

technology-insights

Program with the aim of using the data from Stack Overflow Insights 20...

2   3   3  

instagrammer

NodeJS module NPM package that helps to scrap instagram profile media,...

0   3   3  

nichijou.server.spider.bangumi

🧊 Spider for bgm.tv (or its mirror site)

1   3   3  

ConfettiSpaghetti

Automatic generation of YouTube compilation videos from subreddits

0   3   3  

bing-search

Python command line application to search queries and dorks on bing.co...

1   3   3  

graph-dom

Extract web data by GraphQL and DOM API

0   3   3  

PastebinScraper

Scraper made for downloading stuffs from pastebin.

3   3   3  

easy_scrape

Scraping made easy

2   3   3  

vanguard-kit

A convenient way to calculate the difference between html files to scr...

3   3   3  

quotes-scraping-selenium-python

In this script i extracted quotes in a csv file from https://www.goodr...

0   3   3  

What-Does-BLM-Say

This is an analysis on Black Lives Matter Tweets from Normal People an...

0   3   3  

git-spy

command-line tool to efficiently collect github repository

0   3   3  

GitUserDetailsFinder

To get User Details (name, company, location, email) of Subscribers,...

0   3   3  

streamcorn

A simple Android app for scraping streaming websites.

1   3   3  

baiduBot

baidubot is a small package that allows users to scrape search results...

0   3   3  

lmsScraperGo

A scraper for LMS written in Go

1   3   3  

free_proxy

Scraping the free proxy list and use sqlalchemy to save it to the data...

2   3   3  

ClassifiedScraper

A universal scraper mainly intended for classifieds-type websites. Scr...

2   3   3  

fetch_pinterest

Easy way to search and download pins

0   3   3  

sportstats

:running: Web scraping tool to download data from https://www.sportsta...

1   3   3  

topgainers-premarket-scanner

Auto-periodic topgainers premarket scanner

3   3   3  

Exploratory-Data-Analysis-on-SMRT-Tweets

Demo on performing exploratory data analysis (EDA) on train service di...

3   3   3  

backup-my-CF

A tool made to backup(save a copy in local disk) all of your succesful...

8   3   3  

shopify-scraper

Shopify scraper - a scraper for extracting products from any Shopify s...

0   3   3  

FlaskTweepy

This bot will extract the data from the the twitter and display the wh...

0   3   3  

europython2021

Data Ingestion and Big Data @ EUROPYTHON 2021

1   3   3  

student-research-lab-reddit-comment-scraper

For Dr. David Jeong's Research Lab - Summer 2021

1   3   3  

Get-Funds-from-ariva.de

The table obtains important fund measures from ariva.de

1   3   3  

audible_matchmaker

Code and data for Web Scraping in Excel & Python blog post @ gallon.me

2   3   3  

ical_maker

A python web scraping project gets specific dates from KFUPM Registrar...

1   3   3  

i-want-a-ps5

Scrape some websites to check for PS5 stock.

1   3   3  

netkeiba

A reusable Django app which crawls and imports race data from netkeiba...

1   3   3  

digikrawl

Data is the new gold. This repository will help you gain some! Using P...

0   3   3  

githubGrep

This tool will allow you to search for any code on a specific reposito...

0   3   3  

daily-menu-offers

What are my favourite pubs/restaurants serving today?

0   3   3  

scraper

:dizzy: Scrapes the information from the targeted page and provides a...

0   3   3  

Udemy-Coupon-Scraping

Scraping Coupons from techitweets and storing them in an Excel sheet t...

0   3   3  

sadpanda-gallery-scraper

Node.js script for scraping Sadpanda galleries.

0   3   3  

Gasprices_DK

Gasprices in Denmark

1   3   3  

AnimePaheXtractor

a way to download and backup your anime series

1   3   3  

NBA_data_gain_-_analysis

NBA scoreboard web scraping using Python's selenium and Bucks 10 first...

0   3   3  

social-media-scraper

Jupyter Notebooks demonstrating scraping data from social media sites....

0   3   3  

Proxy-Scraper-Checker

Automated Proxy Scraper & Checker for Continuous Works

0   3   3  

LicencePlateScraper

Système automatique pour constituer un dataset de plaque d'immatricula...

2   3   3