Most popular scraping repositories and open source projects

FreshProxies ProHackTech Python

Fresh Proxies | Proxied Browser | HTTP/HTTPS/SOCKS4/SOCKS5

13 6 13

nhkore esotericpig Ruby

🇯🇵📰🗻 NHK News Web (Easy) word frequency (core list) scraper for Japanese language learners.

13 2 13

fastlinkcheck fastai Jupyter Notebook

Check local static links and online links fast and in parallel

13 6 13

pro-penetration fulldecent PHP

Penetration research against NSFW websites

13 2 13

React-YouTube-Comment-Section-Scraper MikeM711 JavaScript

A full stack application that scrapes & filters YouTube comments using Google's Puppeteer, instead of using the YouTube API

13 6 13

api Yalies Python

👥 The best directory of Yale personnel, with a clean API to match. Used by 70% of undergrads!

13 23 13

Tap-News ZhekaiJin Python

Real Time News Scraping and Recommendation System

13 3 13

price_compare_crawler pritpalxyz Python

Product price comparison scrapy crawler

13 7 13

ticker-iq ianramzy Java

📈 Stock screener and portfolio analyzer, providing key insights on financial reports, news articles and more!

13 5 13

curlx devblack PHP

CurlX a basic Curl syntax

13 12 13

italian_dictionary sphoneix22 Python

Package that helps getting the meaning of italian words.

13 6 13

yellowstone-camping juftin Python

Campsite Reservation Cancellation Finder (Yellowstone National Park)

13 6 13

cfr-iris-scraper FlashWebIT CSS

Live train information: scrape-powered API with JSON endpoints for the Romanian national railway infrastructure company CFR S.A's realtime information...

13 2 13

Ipl-Auction Coder-Srinivas JavaScript

A MERN Stack Application designed to mimic the IPL Auction and fill the user's hearts with fun.

13 9 13

Fetcher neriymus JavaScript

A chrome extension which fetches your favourite feeds, so you don't have to.

13 1 13

Aliexpress-telegram fernandod1 Python

Script to post in your Telegram channel your Aliexpress offers reading them from a Excel filename (.csv)

13 2 13

scrapegoat scrapegoat Python

Scrape Data in One-shot.

13 2 13

rust-scraping gregstoll Rust

Examples of web scraping in Rust

13 2 13

google-finance-py dimitryzub Python

Scripts for scraping Google Finance data in Python.

13 5 13

krawler maxgio92 Go

A crawler for kernel releases distributed by the major Linux distributions.

13 0 13

scrapeblocks alexferrari88 TypeScript

Scraping automation framework based on Playwright

13 0 13

Pobieranie-anime-z-polskich-stron docchipl TypeScript

Siema, jeślisz szukasz gotowego kodu do pobierania linków do cda, mega, google drive, itd z Polskich stron to idealnie trafiłeś!

13 2 13

commitstrip-downloader CodeBrauer PHP

a simple script that downloads all comics from commitstrip.com

13 5 13

dynamic-rendering-ultra-generation__vite-vue anhchangvt1994 TypeScript

Advanced SEO for Vite + VueJS Project

13 2 13

UltraScrap-cli Martiinii HTML

Download any song from biggest database of UltraStar songs for your karaoke party!

13 2 13

cms-downloader-refined aboueleyes Python

a tiny script that automates downloading files from guc cms website

13 2 13

jjwxc-crawler dev-chenxing Python

基于Scrapy开发的晋江爬虫，根据书号下载小说非V章节，生成可编辑的Word文档 | A simple tool to scrape and download non-V chapters of any novel from jjwxc....

13 4 13

file-scraper ivan-sincek Python

Scrape files for sensitive information, and generate an interactive HTML report. Based on Rabin2.

13 2 13

occupancy-epfl antoninfaure TypeScript

Backend of Occupancy FLEP, an interface of edu.epfl.ch useful for finding free rooms or schedule by studyplan, at EPFL.

13 0 13

omkar-temp-mail omkarcloud Python

🚀 OMKAR TEMP MAIL HELPS YOU USE TEMPORARY EMAILS. 🤖

13 4 13

Gmail-Auto-Creator rofiq2 C#

Using our tool you can generate Gmail accounts right now!

13 12 13

actor-shopify-scraper pocesar JavaScript

Automate monitoring prices on the most popular solution for building online stores and selling products online. Crawl arbitrary Shopify-powered online...

13 10 13

wtchr willwillems JavaScript

Open-source privacy focused show downloader & tracker.

12 0 12

crawlerUtils Tyrone-Zhao Python

Utils for programming web crawler

12 3 12

wikipedia-to-document ThiagoNelsi JavaScript

This project collects Wikipedia articles from a search term entered by the user and formats the data into a .docx (Word Document) document with images...

12 3 12

columnistos columnistos HTML

Código de @columnistos y sus hermanas

12 13 12

vocabulary-scrapper farhapartex Python

This is a django app for getting the meaning of an English word from command line.

12 5 12

node-fetch-dom stefanocudini HTML

Magic utility that extract javascript global variables from a remote html page.

12 0 12

googleit schollz Go

Get results from search engines.

12 1 12

trends-in-data-science tonyjward R

The objective of this project is to monitor the trends in data science job opportunities. We achieve this through scraping of the jobserve website.

12 3 12

web_scraper ixboy Ruby

An application designed to scrap the web and retrieve information from movie websites. Built with Ruby.

12 0 12

puregym-tracker p-karanthaker PowerShell

A simple shell script written to scrape gym activity data from the PureGym website members' area.

12 3 12

lab MontFerret Go

Test runner for Ferret

12 3 12

AmazonBestSellerBooksScraper davrob01 C#

This program scrapes Amazon to get book data (the ISBN, title, author, price, etc.) of the top 100 Best Selling books in EVERY category and every subc...

12 6 12