Most popular scraping repositories and open source projects

cheinstein.py

🧠 A parsing library for Chegg.com written in Python.

3   12   12  

scraper

All In One API to easily scrape data from any website, without worryin...

3   12   12  

Scrappp

A Very simple free proxy list scraper.

3   12   12  

SuperStarInfoFetch

超星学习通 收件箱、任务、章节、讨论、作业、考试、资料、错题集、学习记...

7   12   12  

Fuelprices_DK

Scraping of 5 types of fuel :fuelpump: from 8 different fuelcompanies...

4   12   12  

google-finance-py

Scripts for scraping Google Finance data in Python.

4   12   12  

eCommerce-Scraping-API

eCommerce Scraping API code examples for Python, PHP and Node.js

2   12   12  

clone-anonymous-github

Easily download anonymous Github repositories from https://anonymous.4...

0   12   12  

irasutoya

:woman: Ruby library for いらすとや

1   11   11  

wikipedia-to-document

This project collects Wikipedia articles from a search term entered by...

3   11   11  

columnistos

Código de @columnistos y sus hermanas

12   11   11  

vocabulary-scrapper

This is a django app for getting the meaning of an English word from c...

5   11   11  

googleit

Get results from search engines.

1   11   11  

Predicting-Trump

Predicting Trump's Tweets With A Character Level Recurrent Neural Netw...

2   11   11  

hll-algorithm-sample

HLL Algorithm and Web Scraping sample

2   11   11  

trends-in-data-science

The objective of this project is to monitor the trends in data science...

3   11   11  

scrape-them-all

🚀 An easy-to-handle Node.js scraper that allow you to scrape them all...

0   11   11  

instagram-unfollowers-unfollowing

Python scripts for detecting and analysing unfollowers and unfollowing...

1   11   11  

puregym-tracker

A simple shell script written to scrape gym activity data from the Pur...

3   11   11  

lab

Test runner for Ferret

3   11   11  

price_compare_crawler

Product price comparison scrapy crawler

6   11   11  

camp-collective

An incomplete bandcamp python toolset (mainly downloads your collectio...

3   11   11  

imageboard-dl

Image downloader for various imageboards and image albums written in P...

4   11   11  

Google-Meet-Attendance-using-Python

Take the GoogleMeet Attendance without much effort!

7   11   11  

puppeteer-boiler

🛢 A batteries included boilerplate for puppeteer-extra. Automate all t...

2   11   11  

aws-outages

Track AWS outages via Git History

2   11   11  

scrapingant-client-js

ScrapingAnt API client for JavaScript / Node.js.

1   11   11  

emailscraper

Minimalistic library to scrape emails from websites with headless brow...

3   11   11  

Saffron

A fairly intuitive & powerful framework that enables you to collect &...

0   11   11  

data-engineering-challenge-th

Dockerizing a Python Script for Web Scraping and consume the scraped d...

0   11   11  

outscraper-php

The library provides convenient access to the Outscraper API from appl...

3   11   11  

scrapegoat

Scrape Data in One-shot.

2   11   11  

game-watch

Overview of game release dates, prices and news

4   11   11  

Scrape-GettyImages-Using-Selenium

Using python and selenium download images from gettyimages.com

5   11   11  

SERP-Scraping-API

SERP Scraping API code examples for Python, PHP and Node.js

3   11   11  

TD-Spider

Via Text Density Simple Web Crawler With Go

0   11   11  

commitstrip-downloader

a simple script that downloads all comics from commitstrip.com

4   11   11  

kirinuki-core

Kirinuki is a library that convert any html to JSON using CSS selector...

1   10   10  

Linkedin-Scraper

Selenium based LinkedIn profile data scraper

0   10   10  

future-contest

Competition programming calendar (AtCoder, yukicoder, Codeforces, CS A...

0   10   10  

scraper-engine

Async Scraper Framework Based Nodejs

7   10   10  

core

🕵️ The core packages of security analyzer web crawler

1   10   10  

sinonimos

🇧🇷 Find synonyms without leaving your terminal

7   10   10  

BK

Finds a fork in the tennis matches betting marathonbet and plusminus

3   10   10  

AmazonBestSellerBooksScraper

This program scrapes Amazon to get book data (the ISBN, title, author,...

5   10   10  

previsao-ondas

🌊 Scraping de previsão de ondas no Brasil

2   10   10  

instagram-scraping

Python script to scrap deskgram (Deskgram is a desktop version of Inst...

6   10   10  

vidpy

A Python based customizable script for scraping links to videos hosted...

3   10   10  

web-scraping

Code samples of web scraping using Java.

6   10   10  

pro-penetration

Penetration research against NSFW websites

2   10   10