Most popular scraping repositories and open source projects

Cutlery

Python Script for Copywriters to Gather Data from Competing Content an...

2   12   12  

TD-Spider

Via Text Density Simple Web Crawler With Go

0   12   12  

puppeteer-copy-content

A basic web script for copying contents

1   12   12  

spido

Web crawler/spider for node.js & nest.js server

0   12   12  

google-scholar-scraper

Export the articles and reports from Google Scholar easily! (The spide...

0   12   12  

ReicheltAPI

A very simple Python web scraping module for Reichelt Elektronik

1   12   12  

wtchr

Open-source privacy focused show downloader & tracker.

0   12   12  

crawlerUtils

Utils for programming web crawler

3   12   12  

wikipedia-to-document

This project collects Wikipedia articles from a search term entered by...

3   12   12  

columnistos

Código de @columnistos y sus hermanas

13   12   12  

vocabulary-scrapper

This is a django app for getting the meaning of an English word from c...

5   12   12  

node-fetch-dom

Magic utility that extract javascript global variables from a remote h...

0   12   12  

googleit

Get results from search engines.

1   12   12  

trends-in-data-science

The objective of this project is to monitor the trends in data science...

3   12   12  

web_scraper

An application designed to scrap the web and retrieve information from...

0   12   12  

puregym-tracker

A simple shell script written to scrape gym activity data from the Pur...

3   12   12  

lab

Test runner for Ferret

3   12   12  

AmazonBestSellerBooksScraper

This program scrapes Amazon to get book data (the ISBN, title, author,...

6   12   12  

simple-email-scraper

Simple Email Scraper

3   12   12  

WebnovelYoinker

Downloads converts webnovels to Epub or PDF. Supported websites: wuxia...

2   12   12  

vizcacha

Web scrapers using Scrapy framework to collect prices from online supe...

6   12   12  

fb-scraping-tools

A unit tested set of tools written in Python to scrape / collect data...

2   12   12  

Google-Meet-Attendance-using-Python

Take the GoogleMeet Attendance without much effort!

7   12   12  

pukpuk

HTTP discovery and change monitoring tool

3   12   12  

Django-Search-Engine

Django Search Engine, Scrape links and text from different search engi...

11   12   12  

aws-outages

Track AWS outages via Git History

3   12   12  

scrapingant-client-js

ScrapingAnt API client for JavaScript / Node.js.

2   12   12  

cloudflare-iuam-solver

CloudflareIuamSolver is the Java library for breaking through the Clou...

4   12   12  

covid19br-pub

Projeto de monitoramento de publicações oficiais relacionadas a COVID-...

0   11   11  

gathering_data

Примеры к книге "Сбор данных в Интернете на языке R".

3   11   11  

Predicting-Trump

Predicting Trump's Tweets With A Character Level Recurrent Neural Netw...

2   11   11  

hll-algorithm-sample

HLL Algorithm and Web Scraping sample

2   11   11  

scraper-engine

Async Scraper Framework Based Nodejs

7   11   11  

web-scraper

simple web scraping: extract texts and links as CSV, and save images o...

2   11   11  

journal

A movie journal coupled with open IMDb data, and a Flask web-app for e...

0   11   11  

BK

Finds a fork in the tennis matches betting marathonbet and plusminus

3   11   11  

vidpy

A Python based customizable script for scraping links to videos hosted...

3   11   11  

scrapy-proxycrawl-middleware

Scrapy middleware interface to scrape using ProxyCrawl proxy service

3   11   11  

Advanced_PHP_Scrapping

Enhanment Scrapping API for six hotel booking website from Expedia.com...

8   11   11  

camp-collective

An incomplete bandcamp python toolset (mainly downloads your collectio...

3   11   11  

Nepali-news-portal-kbd

Online webapp that scrapes news from different new portals of Nepal an...

3   11   11  

India-Trade-Data

A web scraper written in Python to gather trade data for India across...

7   11   11  

music-festivals

Festivals dominated by male acts, study shows, as Glastonbury begins

0   11   11  

TED-Scraper

Complete Web Scraping of TED.com for Metadata, Transcript, Audio, Vide...

6   11   11  

get-dream

予約困難な東京ディズニーリゾートの予約を自動化

4   11   11  

OneFreeMonth

Get free month on Netflix, OCS... using Selenium and Python

12   11   11  

Scraping-Jumia-Ecommerce

Using the Scrapy framework to scrape data consisting of name, brand, r...

14   11   11  

Saffron

A fairly intuitive & powerful framework that enables you to collect &...

0   11   11  

python-selenium-scraper-template

Watch your python scraper with selenium in a docker container

9   11   11  

ResultAthle

Scraping, visualisation et analyse de résultats d'athlétisme depuis le...

2   11   11