Most popular scraping repositories and open source projects

scrape-rec

Real estate data gathering and notification

2   3   3  

TextMining

0   3   3  

versions-scraper

Este projeto contém scripts de raspagem de dados que extraem dados de...

0   3   3  

HIVE

Django-based web app developed for the UofM Bioinformatics Dept, now i...

1   3   3  

Wroflats

User-friendly client designed for browsing real estates with dynamical...

0   3   3  

prestige-of-districts

:mag_right: This application parses sites and retrieves data associate...

1   3   3  

Scrapers

Repository of python based web scrapers for numerous websites.

0   3   3  

artograph

An app to geographically visualize and organize tattoo artist informat...

0   3   3  

iFixit-Repairability-Dashboard

Pulls repairability scores for various devices from iFixit, which are...

1   3   3  

SimpleDesktop-Bot

This simple script crawl wallpepers site Simpledesktops.com and downlo...

0   3   3  

Line-Bot

APIとスクレイピングを学んでいたので作ってみました。自身では初めての成...

0   3   3  

Crumbls-Web-Scraper

Click and point to turn any webpage into an API.

0   3   3  

yelp-search

Code to search for business listings on yelp.com

3   3   3  

scraping-livedoorNEWS

livedoor NEWS の記事をスクレイピングするやつ

1   3   3  

naverBlogToMarkdown

네이버 블로그를 자동적으로 마크다운 형식으로 변환해주는 파이썬 기반 프...

0   3   3  

NLP_ND

Udacity Natural Language Processing Nanodegree.

0   3   3  

MSRIT-Results

Web app for MSRIT results.

2   3   3  

java-webscraping

How to scrape data from a website using java

3   3   3  

Quora

1   3   3  

GutenbergScrapper

This repo contains a scrapper for the Gutenberg's project website whic...

2   3   3  

kromium

Kromium is Chrome automation library written in Kotlin

0   3   3  

Websec

Websec

2   3   3  

technology-insights

Program with the aim of using the data from Stack Overflow Insights 20...

2   3   3  

instagrammer

NodeJS module NPM package that helps to scrap instagram profile media,...

0   3   3  

nichijou.server.spider.bangumi

🧊 Spider for bgm.tv (or its mirror site)

1   3   3  

ConfettiSpaghetti

Automatic generation of YouTube compilation videos from subreddits

0   3   3  

bing-search

Python command line application to search queries and dorks on bing.co...

1   3   3  

graph-dom

Extract web data by GraphQL and DOM API

0   3   3  

PastebinScraper

Scraper made for downloading stuffs from pastebin.

3   3   3  

easy_scrape

Scraping made easy

2   3   3  

vanguard-kit

A convenient way to calculate the difference between html files to scr...

3   3   3  

quotes-scraping-selenium-python

In this script i extracted quotes in a csv file from https://www.goodr...

0   3   3  

What-Does-BLM-Say

This is an analysis on Black Lives Matter Tweets from Normal People an...

0   3   3  

git-spy

command-line tool to efficiently collect github repository

0   3   3  

GitUserDetailsFinder

To get User Details (name, company, location, email) of Subscribers,...

0   3   3  

streamcorn

A simple Android app for scraping streaming websites.

1   3   3  

baiduBot

baidubot is a small package that allows users to scrape search results...

0   3   3  

lmsScraperGo

A scraper for LMS written in Go

1   3   3  

free_proxy

Scraping the free proxy list and use sqlalchemy to save it to the data...

2   3   3  

ClassifiedScraper

A universal scraper mainly intended for classifieds-type websites. Scr...

2   3   3  

fetch_pinterest

Easy way to search and download pins

0   3   3  

sportstats

:running: Web scraping tool to download data from https://www.sportsta...

1   3   3  

topgainers-premarket-scanner

Auto-periodic topgainers premarket scanner

3   3   3  

Exploratory-Data-Analysis-on-SMRT-Tweets

Demo on performing exploratory data analysis (EDA) on train service di...

3   3   3  

backup-my-CF

A tool made to backup(save a copy in local disk) all of your succesful...

8   3   3  

shopify-scraper

Shopify scraper - a scraper for extracting products from any Shopify s...

0   3   3  

FlaskTweepy

This bot will extract the data from the the twitter and display the wh...

0   3   3  

europython2021

Data Ingestion and Big Data @ EUROPYTHON 2021

1   3   3  

student-research-lab-reddit-comment-scraper

For Dr. David Jeong's Research Lab - Summer 2021

1   3   3  

Get-Funds-from-ariva.de

The table obtains important fund measures from ariva.de

1   3   3