Most popular scraping repositories and open source projects

souq

Scrapy Crawler for souq Website

3   5   5  

ImageExtract

A Swift library to allows you to extract the size of an image without...

0   5   5  

Scrapy

Scrapy proxy authentication example for Smartproxy

0   5   5  

WhatsApp-WebBot

Gets content from the web and send to whatsapp, and allows user to sen...

1   5   5  

earthquakesPortugal

💥 Web scrapping with Puppeteer and X-Ray + MEAN single app with Googl...

0   5   5  

rap_album_sentiment_analysis

Sentiment analysis on rap albums in R

1   5   5  

google-search-results-golang

Scrape and parse Google search results in Golang

1   5   5  

waya-scrape

Scrape search engines for lists of keywords

3   5   5  

Automated-Price-Comparison

A Platform designed to track different products on the biggest Ecommer...

0   5   5  

amazon-crawler

Amazon crawler and scraper bot

1   5   5  

appstore-profile-scraper

Apple App Store Profile (SCRAPPER) Information Scraper

0   5   5  

dozent

Dozent is a powerful downloader that is used to collect large amounts...

0   5   5  

SUS

Social Usernames Scraper

4   5   5  

cineplex-api-php

🍿 A scraper and REST endpoint for the Cineplex.com APIs.

0   5   5  

Chapter-4

Code examples for Chapter 4 of Data Wrangling with JavaScript

0   5   5  

JobSearchScrapeAndApply

Scraping job search results using various APIs

4   5   5  

Google-Cloud-Functions-PhantomJS-Scraper

A PhantomJS Scraper function for Google Cloud Functions

2   5   5  

emailcheck

Check if a Yahoo Email ID is valid using Selenium (Python)

3   5   5  

lyriks.js

A lyrics scraping api for nodejs

2   5   5  

docker-python-webdriver

Dockerised python with webdrivers for Chrome and Firefox.

1   5   5  

cryptocheck

Keep track of the latest cryptocurrency data with CryptoCheck.

0   5   5  

jobs-ranker

Jobs-ads relevance learner, ranker, deduplicator, and scraper. Webapp...

0   5   5  

web-scraper-steps

Stages of a first Python script for scraping

1   5   5  

curry-digger

Scraping the web: experiments with functional programming in javascrip...

0   5   5  

email-scraper

Email scraper is the JS version of 'https://github.com/kichik/email-sc...

0   5   5  

social-selectors

SocialSelectors is a dynamically updated library of css selectors for...

1   5   5  

carbonaraextractor

Product specifications extractor driven by a DOM Classifier.

3   5   5  

FEUP-exams-website

The FEUP exams website no one asked for

0   5   5  

mdb-twitter-network

Twitter network of members of the 19th German Bundestag

1   5   5  

newspaper-scraping

Open & free access to subscription-based regional newspaper through RS...

0   5   5  

bchydro-outages

Track BCHydro Outages via Git history

4   5   5  

ffb.depot.client

Ein Java-Client für FFB-Depots. Features: Stammdaten und Depotbestände...

0   4   4  

caixa.py

1   4   4  

most-frequently-used-keywords-in-devops-jobs-au

What are the most frequently used keywords in DevOps & Solution Archit...

1   4   4  

twitter_outils

Useful tools to scrape twitter: get all replies to a list of tweets, o...

0   4   4  

filmparser

Getting new films from baskino.me

0   4   4  

Social-Network-Scraper

CLI tool for scraping Instagram, Youtube & Facebook (freelance mission...

1   4   4  

galaxy-scraper-extension

Chrome extension that automatically scrape and send data from a webpag...

1   4   4  

node-crawling-framework

✨ NodeJs crawling & scraping framework heavily inspired by Scrapy

1   4   4  

wallpaperscraper

this python script download all wallpapers from http://simpledesktops....

1   4   4  

scrape-to-wp

Scrape web pages directly into WordPress

0   4   4  

nyt-puzzle-scraper

Scrapes NY Times Mini Crosswords puzzle everyday through AWS Lambda &...

2   4   4  

long-term-care-db

Code and data for Kept in the Dark, story in The Oregonian/OregonLive....

2   4   4  

lulz-scraping

Scraping the data you want from a website by specifying your output in...

0   4   4  

go_concurrent_scraping

Basic concurrent web scraper in Go

1   4   4  

Scraping-Lion-Air-Reviews-on-TripAdvisor-with-R

Cara mudah untuk mendapatkan data ulasan pelanggan secara keseluruhan...

1   4   4  

barclays-balance-fetcher

Scrape current balance from Barclays and append to a Google Spreadshee...

0   4   4  

Course-Page-Downloader

Downloads contents of VIT Academics Course Page and organizes them nic...

2   4   4  

imap-mail-scraper

Mail messages scraping via IMAP

0   4   4  

rails-web-scraper-micro-service

a side project: Web Scraper micro service with Rails 5 API mode

1   4   4