Most popular scraping repositories and open source projects

stylish calinvasileandrei Dart

A simple style app that allows you to categorize items from different online stores! Implement scraping for easy data entry

2 0 2

prowler ispyhumanfly Perl

Query the web, extract data from the results, and transform that data into a format you can use.

2 0 2

fetch-amul-topicals vineetjc Python

Python script to fetch Amul Topicals (original: https://github.com/k4rtik/fetch-topicals)

2 6 2

amFOSS-Tasks akhilam512 C++

amFOSS Tasks

2 1 2

icealert PlazaCommunity JavaScript

DOL scraping bot for University of Trento: ICE students

2 0 2

lightshot-data-miner hostinfodev Python

A random idea I had a while back to make a data miner for lightshot. Never released this but after a friend sent me a post about lightshot's transpare...

2 1 2

parser KhamdullaevUz PHP

Parsing web site

2 0 2

sytadin-scraper kakwa Perl

sytadin traffic info scraper written in perl

2 4 2

news_segregator praneetmehta Python

KMeans unsupervized learning algorithm news seggregator

2 0 2

insta-scraper antonreshetov JavaScript

Promise-based javascript instagram scraper on client

2 1 2

scrapper nightawks Python

Python Scripts for scrapping ERP.

2 0 2

thebachelor imjakedaniels

Analyzing The Bachelor's Season Ratings and Finding the WORST bachelor

2 1 2

aws-lambda-puppeteer-bootstrap dbritto-dev JavaScript

Boilerplate for use Puppeteer on AWS Lambda

2 0 2

sitealyzer hush2 PHP

SiteAlyzer uncovers the 'technologies' used on websites.

2 2 2

wiki-scraper marinakiseleva Python

This web crawler uses Scrapy py to crawl Wikipedia. It prints the page title, total word count, and page category (using openpyxl) to an Excel workboo...

2 1 2

WDB109_Puppeteer yujiosaka JavaScript

WEB+DB PRESS Vol.109 特集「速習Puppeteer──ヘッドレスChromeでテスト＆スクレイピング」サンプルコード

2 0 2

sentinel-scraper joseortuno TypeScript

Scraper is a tool for scraping websites

2 0 2

advanced-python3 LSIND Python

OOP in Python, working with SQL and NOSQL dbs, fetching HTML data

2 3 2

imge knassar702 Python

open source tool for downloading images from random websites

2 0 2

prox nicksherron Go

A fast cli tool for finding and testing proxies from the web. Inspired by ProxyBroker and written in Go.

2 0 2

covid-vaccine-tracker armsp Python

Dataset of the use and authorization of covid vaccines.

2 1 2

mueller-report-ebook jonscheiding JavaScript

Reflowable e-book version of the 2019 Special Counsel investigation report

2 1 2

getajob dokugo JavaScript

Get the vacancies in my hometown from the local job search website via headless browser crawling.

2 0 2

LinkedIn_Fetcher faydogan Python

Fetches The Job Postings In LinkedIn

2 0 2

YouTube-Scrapping m0-k1 Jupyter Notebook

Scraped YouTube site for video links and other meta-data

2 3 2

stylish-backend calinvasileandrei Python

Backend for the stylish application made with flask. Implements a Website-> Class approach extending the WebsiteClass so you can create a class for ev...

2 0 2

IronTranslator med933 Python

Google translate API for Python

2 0 2

SSS-Steam-Sale-Scraper abhishekti7 Python

2 0 2

chock.press urre JavaScript

Having fun with Swedish evening news.

2 0 2

politescraper saidaspen Java

Polite scraping of the web

2 0 2

anime_filler pinheirolucas Dart

https://animefillerlist.com sample app

2 0 2

Twitter-Sentiment-Analysis AhmadSubadri Jupyter Notebook

Sentiment Analysis with jupyter notebook python by Pycharm Edu

2 0 2

Healthcare-Products-Crawler-Experiment AtulJoshi1 Jupyter Notebook

Extracts product urls for some given categories and then crawls those urls to get data in csv.

2 0 2

linkedin-job-scraper ghazimuharam Python

Linkedin Job Scraper with Selenium

2 0 2

Web-Scrapping-With-JSOUP Jahidul007 Java

Web scraping with java for fun and learning.........

2 4 2

krabber ledgitbe TypeScript

Easy web scraping with AXIOS and JSDOM - this is a mirror of https://gitlab.com/ledgit/krabber

2 1 2

nox-spellenzolder-rating JPAntonisse Python

Extract boardgames scoring from Nox Youtube Videos.

2 0 2

google-forms-filler FedorAronov Python

Scriptable GoogleForms filling tool.

2 1 2

hdxscraper-undp-climate nerevu Python

UNDP Climate Change Data Collector

2 0 2

WebScrape CunningDJ Python

Playing with web scraping. screen_scraper main() method allows image harvesting, linkedin parse_url() grabs job descriptions, indeed accesses the Ind...

2 0 2

API1fichier Timmy93 PHP

Provide easy to use API to manage your 1fichier account through PHP

2 0 2

csmdirsearch jackrosenthal Python

Search the Mines directory

2 0 2

Eurexess_PhD_Scraper ali-kishk Jupyter Notebook

Web Scarper for Jobs in Eurexess

2 0 2

110-Tidings diskxo Python

🚀🏠 Bot Telegram realizzato in Python, con la funzione di inoltrare in chat gli ultimi annunci e le ultime notizie riguardanti il Superbonus Casa 110...

2 0 2