Most popular scraping repositories and open source projects

epl-oracle

Predicting EPL results improving the betting odds.

1   6   6  

stockscrape

Getting stock price data using a python script.

4   6   6  

Jobtimize

Collect and standardize data for all types of advertisements on job po...

1   5   5  

infk-uebungsscraper-java

get all your exercises with one click

3   5   5  

stock-monitor

Scrapes stock data into a database and makes available via a GraphQL A...

3   5   5  

stackoverflow_documentation_PDF

Scrape and convert Stackoverflow documentation to formatted and printa...

2   5   5  

challenge-back-end

Challenge para desenvolvedor back-end python.

0   5   5  

elixir_scraper

Elixir/Hound web scraper example

1   5   5  

libraries

Data used in the story 'Libraries lose a quarter of staff as hundreds...

4   5   5  

Web-Scrappers

2   5   5  

drudge_parser

Web Scraper/Parser for the drudge report

1   5   5  

recipes

Stable website to be scraped by @lewagon students

1   5   5  

netflix

Unofficial API crawler to get Netflix viewing history.

0   5   5  

scraping-ml

Scraping a https://mercadolibre.com.co

0   5   5  

souq

Scrapy Crawler for souq Website

3   5   5  

Scrapy

Scrapy proxy authentication example for Decodo

0   5   5  

WhatsApp-WebBot

Gets content from the web and send to whatsapp, and allows user to sen...

1   5   5  

earthquakesPortugal

💥 Web scrapping with Puppeteer and X-Ray + MEAN single app with Googl...

0   5   5  

rap_album_sentiment_analysis

Sentiment analysis on rap albums in R

1   5   5  

google-search-results-golang

Scrape and parse Google search results in Golang

1   5   5  

waya-scrape

Scrape search engines for lists of keywords

3   5   5  

Automated-Price-Comparison

A Platform designed to track different products on the biggest Ecommer...

0   5   5  

amazon-crawler

Amazon crawler and scraper bot

1   5   5  

appstore-profile-scraper

Apple App Store Profile (SCRAPPER) Information Scraper

0   5   5  

dozent

Dozent is a powerful downloader that is used to collect large amounts...

0   5   5  

SUS

Social Usernames Scraper

4   5   5  

cineplex-api-php

🍿 A scraper and REST endpoint for the Cineplex.com APIs.

0   5   5  

Chapter-4

Code examples for Chapter 4 of Data Wrangling with JavaScript

0   5   5  

JobSearchScrapeAndApply

Scraping job search results using various APIs

4   5   5  

Google-Cloud-Functions-PhantomJS-Scraper

A PhantomJS Scraper function for Google Cloud Functions

2   5   5  

emailcheck

Check if a Yahoo Email ID is valid using Selenium (Python)

3   5   5  

lyriks.js

A lyrics scraping api for nodejs

2   5   5  

docker-python-webdriver

Dockerised python with webdrivers for Chrome and Firefox.

1   5   5  

cryptocheck

Keep track of the latest cryptocurrency data with CryptoCheck.

0   5   5  

jobs-ranker

Jobs-ads relevance learner, ranker, deduplicator, and scraper. Webapp...

0   5   5  

web-scraper-steps

Stages of a first Python script for scraping

1   5   5  

curry-digger

Scraping the web: experiments with functional programming in javascrip...

0   5   5  

email-scraper

Email scraper is the JS version of 'https://github.com/kichik/email-sc...

0   5   5  

social-selectors

SocialSelectors is a dynamically updated library of css selectors for...

1   5   5  

carbonaraextractor

Product specifications extractor driven by a DOM Classifier.

3   5   5  

FEUP-exams-website

The FEUP exams website no one asked for

0   5   5  

order-metrics-data-automation

OrderMetrics.io Automation for data from there to Google Sheets (sprea...

2   5   5  

mdb-twitter-network

Twitter network of members of the 19th German Bundestag

1   5   5  

newspaper-scraping

Open & free access to subscription-based regional newspaper through RS...

0   5   5  

bchydro-outages

Track BCHydro Outages via Git history

4   5   5  

Hotel-Web-Scraper

Web scraper for hotels.com, expedia.com

3   5   5  

ddc-dashboard-scraping

Scraping Thailand COVID-19 data from the DDC's tableau dashboard

0   5   5  

imgbot

Download image posts from subreddits.

2   5   5  

scrape-your-music

Scraping rateyourmusic.com

1   5   5  

cricket_updates

Allows you to get updates about the latest cricket matches in your ter...

0   5   5