Most popular scraping repositories and open source projects

tokopedia-scraper

Example Tokopedia Scraper

9   5   5  

ffb.depot.client

Ein Java-Client für FFB-Depots. Features: Stammdaten und Depotbestände...

0   4   4  

caixa.py

1   4   4  

most-frequently-used-keywords-in-devops-jobs-au

What are the most frequently used keywords in DevOps & Solution Archit...

1   4   4  

twitter_outils

Useful tools to scrape twitter: get all replies to a list of tweets, o...

0   4   4  

filmparser

Getting new films from baskino.me

0   4   4  

Social-Network-Scraper

CLI tool for scraping Instagram, Youtube & Facebook (freelance mission...

1   4   4  

galaxy-scraper-extension

Chrome extension that automatically scrape and send data from a webpag...

1   4   4  

node-crawling-framework

✨ NodeJs crawling & scraping framework heavily inspired by Scrapy

1   4   4  

wallpaperscraper

this python script download all wallpapers from http://simpledesktops....

1   4   4  

scrape-to-wp

Scrape web pages directly into WordPress

0   4   4  

nyt-puzzle-scraper

Scrapes NY Times Mini Crosswords puzzle everyday through AWS Lambda &...

2   4   4  

long-term-care-db

Code and data for Kept in the Dark, story in The Oregonian/OregonLive....

2   4   4  

lulz-scraping

Scraping the data you want from a website by specifying your output in...

0   4   4  

go_concurrent_scraping

Basic concurrent web scraper in Go

1   4   4  

Scraping-Lion-Air-Reviews-on-TripAdvisor-with-R

Cara mudah untuk mendapatkan data ulasan pelanggan secara keseluruhan...

1   4   4  

barclays-balance-fetcher

Scrape current balance from Barclays and append to a Google Spreadshee...

0   4   4  

Course-Page-Downloader

Downloads contents of VIT Academics Course Page and organizes them nic...

2   4   4  

imap-mail-scraper

Mail messages scraping via IMAP

0   4   4  

rails-web-scraper-micro-service

a side project: Web Scraper micro service with Rails 5 API mode

1   4   4  

scraper

Webscraping by using electron

3   4   4  

ScrapeDroid

An effective android library that can be used for web scraping by supp...

1   4   4  

criticalsyncing

Get the different prospective on news

1   4   4  

photo-dataset-scraper

Tools to create a labelled dataset of photos for deep learning image c...

1   4   4  

AISearchImage

Intelligent Search Engine Of Services Image-Based

0   4   4  

html-parser

Xpath, regex and CSS Selector parser

1   4   4  

news-lens

Filtering Political Bias in American News Media

1   4   4  

naruto-name-generator

Foi treinada uma rede neural recorrente (RNN) em um conjunto de dados...

0   4   4  

srcget

Download latest *stable* source

1   4   4  

data-scraper

❤️ The data scraper for big data

5   4   4  

mojok_archive

Website archiving project for Mojok.co website, based on scrapping.

1   4   4  

python-sentimentbrexit-analysis

A project about sentiment analysis and graph & network analysis made w...

1   4   4  

wpoke

python library tool to gather wordpress information

0   4   4  

bitsky-builder

Build BitSky Desktop Application, Web Application, and Docker images

0   4   4  

YTscheduledVideos2Ical

Extract your scheduled videos publish date to a ical file so that it a...

0   4   4  

MP-Transportation-Analysis

Program to analyze MP Transportation data and comparing

1   4   4  

lycos

✨All the goodies you'll ever need to scrape the web (NodeJs / Browser...

1   4   4  

node-itunes-rss

Overengineered iTunes rss feed lister https://rss.itunes.apple.com/

0   4   4  

samehadaku.sh

link graber for samehadaku.tv

1   4   4  

Job-Scraper-Bot

幫朋友做好玩的Telegram機器人,已部署到Heroku

1   4   4  

scraping

Resources on scraping

2   4   4  

youcos

:rocket: A simple Python package for scraping YouTube videos and comme...

2   4   4  

Soup-for-Pharo

3   4   4  

spider_project

Template of scraping project using Grab scraping framework

2   4   4  

scielo-scraping

Download all files from SciELO

1   4   4  

git-screened

Automating Github Repository Assessment.

1   4   4  

piculet

Extract data from XML or HTML documents using XPath.

0   4   4  

Scrapy-Middleware

Scrapy Middleware for proxy authentication with Smartproxy

1   4   4  

cuphic

Transform or scrape Hiccup with a declarative DSL.

0   4   4  

OLX-Crawler

This repository contains code of olx crawler to extract public phone n...

1   4   4