Most popular scraping repositories and open source projects

free-stock-tickers

Freely fetch live stock data by scraping web pages

0   5   5  

google-shopping-api

A tutorial on building and using a custom Google Shopping scraper.

0   5   5  

scrapyteer

Web crawling & scraping framework for Node.js on top of headless Chrom...

0   5   5  

ReicheltAPI

A very simple Python web scraping module for Reichelt Elektronik

0   5   5  

tiktok-bot

TikTok video generation from scraping Reddit community posts

0   5   5  

tokopedia-scraper

Example Tokopedia Scraper

9   5   5  

Jobtimize

Collect and standardize data for all types of advertisements on job po...

1   5   5  

infk-uebungsscraper-java

get all your exercises with one click

3   5   5  

stock-monitor

Scrapes stock data into a database and makes available via a GraphQL A...

3   5   5  

stackoverflow_documentation_PDF

Scrape and convert Stackoverflow documentation to formatted and printa...

2   5   5  

challenge-back-end

Challenge para desenvolvedor back-end python.

0   5   5  

elixir_scraper

Elixir/Hound web scraper example

1   5   5  

libraries

Data used in the story 'Libraries lose a quarter of staff as hundreds...

4   5   5  

Web-Scrappers

2   5   5  

drudge_parser

Web Scraper/Parser for the drudge report

1   5   5  

recipes

Stable website to be scraped by @lewagon students

1   5   5  

netflix

Unofficial API crawler to get Netflix viewing history.

0   5   5  

scraping-ml

Scraping a https://mercadolibre.com.co

0   5   5  

souq

Scrapy Crawler for souq Website

3   5   5  

ImageExtract

A Swift library to allows you to extract the size of an image without...

0   5   5  

Scrapy

Scrapy proxy authentication example for Smartproxy

0   5   5  

WhatsApp-WebBot

Gets content from the web and send to whatsapp, and allows user to sen...

1   5   5  

earthquakesPortugal

💥 Web scrapping with Puppeteer and X-Ray + MEAN single app with Googl...

0   5   5  

rap_album_sentiment_analysis

Sentiment analysis on rap albums in R

1   5   5  

google-search-results-golang

Scrape and parse Google search results in Golang

1   5   5  

waya-scrape

Scrape search engines for lists of keywords

3   5   5  

Automated-Price-Comparison

A Platform designed to track different products on the biggest Ecommer...

0   5   5  

amazon-crawler

Amazon crawler and scraper bot

1   5   5  

appstore-profile-scraper

Apple App Store Profile (SCRAPPER) Information Scraper

0   5   5  

dozent

Dozent is a powerful downloader that is used to collect large amounts...

0   5   5  

SUS

Social Usernames Scraper

4   5   5  

Scraping-Jumia-Ecommerce

Using the Scrapy framework to scrape data consisting of name, brand, r...

11   5   5  

cineplex-api-php

🍿 A scraper and REST endpoint for the Cineplex.com APIs.

0   5   5  

Chapter-4

Code examples for Chapter 4 of Data Wrangling with JavaScript

0   5   5  

JobSearchScrapeAndApply

Scraping job search results using various APIs

4   5   5  

Google-Cloud-Functions-PhantomJS-Scraper

A PhantomJS Scraper function for Google Cloud Functions

2   5   5  

emailcheck

Check if a Yahoo Email ID is valid using Selenium (Python)

3   5   5  

lyriks.js

A lyrics scraping api for nodejs

2   5   5  

docker-python-webdriver

Dockerised python with webdrivers for Chrome and Firefox.

1   5   5  

cryptocheck

Keep track of the latest cryptocurrency data with CryptoCheck.

0   5   5  

jobs-ranker

Jobs-ads relevance learner, ranker, deduplicator, and scraper. Webapp...

0   5   5  

web-scraper-steps

Stages of a first Python script for scraping

1   5   5  

curry-digger

Scraping the web: experiments with functional programming in javascrip...

0   5   5  

email-scraper

Email scraper is the JS version of 'https://github.com/kichik/email-sc...

0   5   5  

social-selectors

SocialSelectors is a dynamically updated library of css selectors for...

1   5   5  

carbonaraextractor

Product specifications extractor driven by a DOM Classifier.

3   5   5  

FEUP-exams-website

The FEUP exams website no one asked for

0   5   5  

mdb-twitter-network

Twitter network of members of the 19th German Bundestag

1   5   5  

newspaper-scraping

Open & free access to subscription-based regional newspaper through RS...

0   5   5  

bchydro-outages

Track BCHydro Outages via Git history

4   5   5