Most popular scraping repositories and open source projects

Cutlery

Python Script for Copywriters to Gather Data from Competing Content an...

0 4 4

first-puppeteer-scraper-example

Project built part of the "Web Scraping in JavaScript – How to Use Pup...

2 4 4

node-gui-scraper

A GUI Based Web-Scraper for scraping e-commerce website using NodeJS

2 4 4

AutoMudae

Userscript for Tampermonkey that automates the use of Mudae bot in Dis...

0 4 4

trading212-pie-sync

🍰 Python tool to automate Trading212 pies allocations by syncing to a...

1 4 4

crawler

An URL crawler created by go-rod.

0 4 4

bus_arrival_time

Automatismo que mediante github actions, se crea un cron-job para scra...

0 4 4

Ebay-Web-Scrapper

A basic python web scrapper for Ebay-Kleinanzeigen.

1 4 4

estela-entrypoint

estela entrypoint for job runner 🕸

1 4 4

NAS-2021-data

Raw data from NAS 2021 report

1 4 4

Scraper

Scrapping travel website using CasperJs

0 3 3

scrape-rec

Real estate data gathering and notification

2 3 3

TextMining

0 3 3

versions-scraper

Este projeto contém scripts de raspagem de dados que extraem dados de...

0 3 3

HIVE

Django-based web app developed for the UofM Bioinformatics Dept, now i...

1 3 3

Wroflats

User-friendly client designed for browsing real estates with dynamical...

0 3 3

prestige-of-districts

:mag_right: This application parses sites and retrieves data associate...

1 3 3

Scrapers

Repository of python based web scrapers for numerous websites.

0 3 3

artograph

An app to geographically visualize and organize tattoo artist informat...

0 3 3

iFixit-Repairability-Dashboard

Pulls repairability scores for various devices from iFixit, which are...

1 3 3

SimpleDesktop-Bot

This simple script crawl wallpepers site Simpledesktops.com and downlo...

0 3 3

Line-Bot

APIとスクレイピングを学んでいたので作ってみました。自身では初めての成...

0 3 3

Crumbls-Web-Scraper

Click and point to turn any webpage into an API.

0 3 3

yelp-search

Code to search for business listings on yelp.com

3 3 3

scraping-livedoorNEWS

livedoor NEWS の記事をスクレイピングするやつ

1 3 3

naverBlogToMarkdown

네이버 블로그를 자동적으로 마크다운 형식으로 변환해주는 파이썬 기반 프...

0 3 3

NLP_ND

Udacity Natural Language Processing Nanodegree.

0 3 3

MSRIT-Results

Web app for MSRIT results.

2 3 3

java-webscraping

How to scrape data from a website using java

3 3 3

Quora

1 3 3

GutenbergScrapper

This repo contains a scrapper for the Gutenberg's project website whic...

2 3 3

kromium

Kromium is Chrome automation library written in Kotlin

0 3 3

Websec

Websec

2 3 3

technology-insights

Program with the aim of using the data from Stack Overflow Insights 20...

2 3 3

instagrammer

NodeJS module NPM package that helps to scrap instagram profile media,...

0 3 3

nichijou.server.spider.bangumi

🧊 Spider for bgm.tv (or its mirror site)

1 3 3

ConfettiSpaghetti

Automatic generation of YouTube compilation videos from subreddits

0 3 3

bing-search

Python command line application to search queries and dorks on bing.co...

1 3 3

graph-dom

Extract web data by GraphQL and DOM API

0 3 3

PastebinScraper

Scraper made for downloading stuffs from pastebin.

3 3 3

easy_scrape

Scraping made easy

2 3 3

vanguard-kit

A convenient way to calculate the difference between html files to scr...

3 3 3

quotes-scraping-selenium-python

In this script i extracted quotes in a csv file from https://www.goodr...

0 3 3

What-Does-BLM-Say

This is an analysis on Black Lives Matter Tweets from Normal People an...

0 3 3

git-spy

command-line tool to efficiently collect github repository

0 3 3

GitUserDetailsFinder

To get User Details (name, company, location, email) of Subscribers,...

0 3 3

streamcorn

A simple Android app for scraping streaming websites.

1 3 3

baiduBot

baidubot is a small package that allows users to scrape search results...

0 3 3

lmsScraperGo

A scraper for LMS written in Go

1 3 3

free_proxy

Scraping the free proxy list and use sqlalchemy to save it to the data...

2 3 3