Most popular scraping repositories and open source projects

puppeteer-web-crawlers-js

⚡ JS-based dynamic web scrappers utilizing the puppeteer library.

1   2   2  

spotify-lyrics-chrome-extension

Get lyrics of the current playing song in Spotify Web - WIP

0   2   2  

Youtube-Bot-

Get Pycon video links and basic stats

4   2   2  

tweet_scraper

A CLI based scraper script for Twitter. Supports languages, search que...

1   2   2  

puckdb

An async-first hockey data extractor and API

1   2   2  

crawl-n-scrape

Simple tool for crawling and scraping web pages; no dependencies

0   2   2  

netsurfer

netsurfer is a very lightweight scraping framework

0   2   2  

SIF_scrape

Scraper to pull spreads and scores for NCAA college football games

1   2   2  

movie-night

Movie Night - Taller de Node.JS para requests y Web Scraping

0   2   2  

scrapy-linky

Scrapes a collection of source pages for a set of possible URL paths,...

0   2   2  

instapy_pubprofiles

Download Instagram Photos and Videos given Link to Posts

0   2   2  

scrapium

This project is a base class for scraping using selenium and python wh...

0   2   2  

IMDB-Web-Scraper

0   2   2  

webmagician

A configurable crawler platorm

0   2   2  

instagram-scraper

instagram-scraper

1   2   2  

scraping-jobs

Scraping-jobs helps scrape jobs from major job boards (apec.fr, indeed...

0   2   2  

scrapingAbogadosPr

scraping a tribunalelectronico

0   2   2  

scrap-materia-unb

Web scraping for downloading UnB subjects names

0   2   2  

daily-menu

Scraper utility tool to fetch daily menus.

4   2   2  

tsa-passenger-throughput

A mini web scraping + data visualization project for number of travele...

1   2   2  

Flatiron-OO-Ruby

Flatiron Full Stack Web Development Curriculum & Labs - Object-Oriente...

35   2   2  

Artnet-Scraper

Python tool to scrap images from artnet website

2   2   2  

crawl-sample

5   2   2  

twitter-quote-scraper

A command line tool for scraping quotations on Twitter

1   2   2  

FlaskExperimentos

Experimentos diversos com Flask: exemplos, tutoriais e pequenos apps.

1   2   2  

Web-Scrapping

This is a quick introduction to WebScrapping

1   2   2  

8bittools

Various scripts for scraping sites with Chiptunes

0   2   2  

stealthchromedriver

Optimized Selenium Chrome webdriver replacement which PASSES browser a...

0   2   2  

youtubecommentsscraper

This is a online youtube comments scraper app deployed on website usin...

0   2   2  

proxyScraperBackend

Proxy Scraper is a Java application developed which purpose is to scra...

0   2   2  

Scraper

It is a python based script which is running on python based framework...

0   2   2  

veil

the uncollectible website

0   2   2  

icj

A package to scrape judgments of the International Court of Justice (h...

0   2   2  

lab

🐍 Scraping y NLP con Python

1   2   2  

soldScraper

Scrapes the auction results page from realestate.com.au and fetches ex...

0   2   2  

marathon-results-analysis

Prague Marathon results scraped from the official website RunCzech.com...

2   2   2  

proxyScraperFrontend

Proxy Scraper is a Java application developed which purpose is to scra...

0   2   2  

stylish

A simple style app that allows you to categorize items from different...

0   2   2  

prowler

Query the web, extract data from the results, and transform that data...

0   2   2  

fetch-amul-topicals

Python script to fetch Amul Topicals (original: https://github.com/k4r...

6   2   2  

amFOSS-Tasks

amFOSS Tasks

1   2   2  

icealert

DOL scraping bot for University of Trento: ICE students

0   2   2  

lightshot-data-miner

A random idea I had a while back to make a data miner for lightshot. N...

1   2   2  

parser

Parsing web site

0   2   2  

sytadin-scraper

sytadin traffic info scraper written in perl

4   2   2  

news_segregator

KMeans unsupervized learning algorithm news seggregator

0   2   2  

insta-scraper

Promise-based javascript instagram scraper on client

1   2   2  

scrapper

Python Scripts for scrapping ERP.

0   2   2  

thebachelor

Analyzing The Bachelor's Season Ratings and Finding the WORST bachelor

1   2   2  

aws-lambda-puppeteer-bootstrap

Boilerplate for use Puppeteer on AWS Lambda

0   2   2