Most popular scraping repositories and open source projects

barclays-balance-fetcher

Scrape current balance from Barclays and append to a Google Spreadshee...

0   4   4  

Course-Page-Downloader

Downloads contents of VIT Academics Course Page and organizes them nic...

2   4   4  

imap-mail-scraper

Mail messages scraping via IMAP

0   4   4  

rails-web-scraper-micro-service

a side project: Web Scraper micro service with Rails 5 API mode

1   4   4  

scraper

Webscraping by using electron

3   4   4  

ScrapeDroid

An effective android library that can be used for web scraping by supp...

1   4   4  

criticalsyncing

Get the different prospective on news

1   4   4  

photo-dataset-scraper

Tools to create a labelled dataset of photos for deep learning image c...

1   4   4  

AISearchImage

Intelligent Search Engine Of Services Image-Based

0   4   4  

html-parser

Xpath, regex and CSS Selector parser

1   4   4  

news-lens

Filtering Political Bias in American News Media

1   4   4  

naruto-name-generator

Foi treinada uma rede neural recorrente (RNN) em um conjunto de dados...

0   4   4  

srcget

Download latest *stable* source

1   4   4  

data-scraper

❤️ The data scraper for big data

5   4   4  

mojok_archive

Website archiving project for Mojok.co website, based on scrapping.

1   4   4  

python-sentimentbrexit-analysis

A project about sentiment analysis and graph & network analysis made w...

1   4   4  

wpoke

python library tool to gather wordpress information

0   4   4  

bitsky-builder

Build BitSky Desktop Application, Web Application, and Docker images

0   4   4  

YTscheduledVideos2Ical

Extract your scheduled videos publish date to a ical file so that it a...

0   4   4  

MP-Transportation-Analysis

Program to analyze MP Transportation data and comparing

1   4   4  

lycos

✨All the goodies you'll ever need to scrape the web (NodeJs / Browse...

1   4   4  

node-itunes-rss

Overengineered iTunes rss feed lister https://rss.itunes.apple.com/

0   4   4  

samehadaku.sh

link graber for samehadaku.tv

1   4   4  

Job-Scraper-Bot

幫朋友做好玩的Telegram機器人，已部署到Heroku

1   4   4  

scraping

Resources on scraping

2   4   4  

youcos

:rocket: A simple Python package for scraping YouTube videos and comme...

2   4   4  

Soup-for-Pharo

3   4   4  

spider_project

Template of scraping project using Grab scraping framework

2   4   4  

scielo-scraping

Download all files from SciELO

1   4   4  

git-screened

Automating Github Repository Assessment.

1   4   4  

piculet

Extract data from XML or HTML documents using XPath.

0   4   4  

Scrapy-Middleware

Scrapy Middleware for proxy authentication with Decodo

1   4   4  

cuphic

Transform or scrape Hiccup with a declarative DSL.

0   4   4  

OLX-Crawler

This repository contains code of olx crawler to extract public phone n...

1   4   4  

comicthread

Get random comics from multiple sources (XKCD, Commitstrip, ...)

0   4   4  

crypto-scraper

Scraping tool to automatically collect tick data from the Bitmex Order...

1   3   3  

crossfit-wod

Random WOD from https://crossfit.com/. Available here: https://igorkos...

0   3   3  

scrapyc

CLI and client library for scrapyd. Done right.

0   3   3  

solidscraper

Easy to use JQuery-Like API for Web Scraping/Crawling.

0   3   3  

ImageScraper

画像をダウンロードするよ

1   3   3  

whats-on-tv

TV Guide with a CLI.

2   3   3  

hdxscraper-world-bank-climate

World Bank Climate Change Data Collector

2   3   3  

pastebin-scraper

A Pastebin scraper that uses scraping APIs

3   3   3  

web_scraping

This document contains the process of scraping data from Bukalapak web...

3   3   3  

stealer

Async website scrapper tool like scrapy built with reactphp.

1   3   3  

lightoj-code-downloader

A simple tool to download accepted codes from Lightoj online judge

1   3   3  

raions

Raions - it's a simple Ukrainian realty estimation service.

2   3   3  

liquidcss

Python package for altering CSS selector names across CSS, HTML and Ja...

0   3   3  

selenium-web-automation-example

A sample web automation project to ease daily login and logout of Offi...

2   3   3  

priceous

Scrapping prices from Ukrainian online whisky shops

0   3   3