Most popular scraping repositories and open source projects

fastlinkcheck

Check local static links and online links fast and in parallel

6   13   13  

pro-penetration

Penetration research against NSFW websites

2   13   13  

api

👥 The best directory of Yale personnel, with a clean API to match. Us...

23   13   13  

Tap-News

Real Time News Scraping and Recommendation System

3   13   13  

price_compare_crawler

Product price comparison scrapy crawler

7   13   13  

ticker-iq

📈 Stock screener and portfolio analyzer, providing key insights on fi...

5   13   13  

curlx

CurlX a basic Curl syntax

12   13   13  

italian_dictionary

Package that helps getting the meaning of italian words.

6   13   13  

yellowstone-camping

Campsite Reservation Cancellation Finder (Yellowstone National Park)

6   13   13  

cfr-iris-scraper

Live train information: scrape-powered API with JSON endpoints for the...

2   13   13  

Ipl-Auction

A MERN Stack Application designed to mimic the IPL Auction and fill th...

9   13   13  

Fetcher

A chrome extension which fetches your favourite feeds, so you don't ha...

1   13   13  

Aliexpress-telegram

Script to post in your Telegram channel your Aliexpress offers reading...

2   13   13  

scrapegoat

Scrape Data in One-shot.

2   13   13  

rust-scraping

Examples of web scraping in Rust

2   13   13  

google-finance-py

Scripts for scraping Google Finance data in Python.

5   13   13  

krawler

A crawler for kernel releases distributed by the major Linux distribut...

0   13   13  

scrapeblocks

Scraping automation framework based on Playwright

0   13   13  

Pobieranie-anime-z-polskich-stron

Siema, jeślisz szukasz gotowego kodu do pobierania linków do cda, mega...

2   13   13  

commitstrip-downloader

a simple script that downloads all comics from commitstrip.com

5   13   13  

scrapy-scraper

Web crawler and scraper based on Scrapy and Playwright's headless brow...

3   13   13  

dynamic-rendering-ultra-generation__vite-vue

Advanced SEO for Vite + VueJS Project

2   13   13  

UltraScrap-cli

Download any song from biggest database of UltraStar songs for your ka...

2   13   13  

cms-downloader-refined

a tiny script that automates downloading files from guc cms website

2   13   13  

jjwxc-crawler

基于Scrapy开发的晋江爬虫，根据书号下载小说非V章节，生成可编辑的Word文...

4   13   13  

file-scraper

Scrape files for sensitive information, and generate an interactive HT...

2   13   13  

occupancy-epfl

Backend of Occupancy FLEP, an interface of edu.epfl.ch useful for find...

0   13   13  

omkar-temp-mail

🚀 OMKAR TEMP MAIL HELPS YOU USE TEMPORARY EMAILS. 🤖

4   13   13  

Gmail-Auto-Creator

Using our tool you can generate Gmail accounts right now!

12   13   13  

actor-shopify-scraper

Automate monitoring prices on the most popular solution for building o...

10   13   13  

Sanfoundry-To-PDF

A Chrome extension designed to help students and educators easily conv...

2   12   12  

omitplastic

A full-stack e-commerce affiliate app focusing on reducing plastic con...

3   12   12  

webtric

Universal Python script to scrape many typical websites

6   12   12  

web-scraping-lvl1

The "web-scraping-lvl1" project is a beginner-level exercise in web sc...

0   12   12  

LeadGenerationAPI

This API is built for lead generation and provides users with a stream...

5   12   12  

scrapetoon

A tool for scraping information from Webtoons.

1   12   12  

Web2LLM

An advanced Python tool for extracting data from websites, cleaning th...

4   12   12  

rcdb-api

🎢RCDB non official Rest API created by scrape RCDB website.

1   12   12  

webtap

AI web scraping python library for efficient and reliable web scraping...

1   12   12  

price_tracker

Dive into web scraping and build a Next.js 14 eCommerce price tracker...

1   12   12  

facebook-event-aggregator

Scrape all upcoming events from specific FB pages, export them to a st...

2   12   12  

zenrows-python-sdk

SDK to access ZenRows API directly from Python. We handle proxies rota...

7   12   12  

YN_Exchange

Crypto python directory (Open source)

0   12   12  

wtchr

Open-source privacy focused show downloader & tracker.

0   12   12  

crawlerUtils

Utils for programming web crawler

3   12   12  

wikipedia-to-document

This project collects Wikipedia articles from a search term entered by...

3   12   12  

columnistos

Código de @columnistos y sus hermanas

13   12   12  

vocabulary-scrapper

This is a django app for getting the meaning of an English word from c...

5   12   12  

node-fetch-dom

Magic utility that extract javascript global variables from a remote h...

0   12   12  

googleit

Get results from search engines.

1   12   12