Most popular scraping repositories and open source projects

LInkedIn-Reverese-Lookup

🔎Search LinkedIn profile by email address📧

7   35   35  

facebook-discussion-tk

A collection of tools to (semi-)automatically collect and analyze data...

6   34   34  

Crawling-Emails

Very simple bash script to crawl email addresses from a specific websi...

16   34   34  

gwaripper

Tool for conveniently downloading audios from r/gonewildaudio and simi...

5   34   34  

cinemaempoa

Site que agrega filmes em cartaz em algumas das diversas salas de cine...

16   34   34  

bbb

Browser Bot Bookmarklet

0   34   34  

python-vistopia

看理想 Python 客户端 / 下载器，下载看理想的音频和文稿

10   34   34  

BSCWhalesMonitor

BSC whales monitor and detector written in Python.

18   34   34  

ioweb

Web Scraping Framework

11   33   33  

emec-api

API Python para consulta na base de dados oficial do e-MEC

12   33   33  

api-flight.com

Main API Flight Git Repository

9   33   33  

jmd_imagescraper

Image scraping library for creating deep learning datasets

15   33   33  

PastebinScrapy

Threat hunting tool for scraping latest scrapes from Pastebin

14   33   33  

vogue-runway-scraper

This application was built to help scrape the fashion looks from diffe...

4   33   33  

fastProxy

MultiThreaded Application to Scrape Working Web Proxies

10   33   33  

midjourney-gallery-downloader

Download Midjourney Showcase images automatically

10   32   32  

Filmweb2Letterboxd

Eksport ocen z Filmweb'u do pliku csv w formacie akceptowanym przez im...

1   32   32  

facebook-page-info-scraper

Free Facebook pages MetaData Scraping Library - Unlimited Calls

5   32   32  

AniSync

Mapping sites to AniList and back.

6   32   32  

strigil

Strigil is an OSINT tool for collecting and aggregating social media d...

5   32   32  

proxi

Proxy pool. Finds and checks proxies with rest api for querying result...

4   32   32  

video-crawler

Crawl websites for videos from Youtube, Vimeo, Soundcloud, etc

5   32   32  

serritor

Serritor is an open source web crawler framework built upon Selenium a...

15   32   32  

fb-event-scraper

Recursively scrape facebook events

3   32   32  

google-search-results-nodejs

Scrape and parse Google search results in Node.JS

3   32   32  

zoominfo_scraper

Zoominfo scraper with using of rotating proxies and headless Chrome fr...

9   32   32  

Thar

Mining all surnames used in Nepal.

9   31   31  

spidyquotes

Example site for web scraping tutorials

18   31   31  

htmlspitter

NodeJS server to spit out HTML from loaded JS using Puppeteer

6   31   31  

Scrapping

Mastering the art of scrapping 🎓

38   31   31  

facebook-snooper

Scrapes Facebook profile pages using a normal login (without an API ke...

7   31   31  

google-search-results-python

Scrape and parse Google search results in Python

9   31   31  

google-search-scraper

TypeScript library for Google search scraping using http requests with...

11   31   31  

local-api-client-csharp

This .NET Standard package provides convenient access to the Local API...

2   31   31  

headless-task-server

A headless browser task/job queue & runner based on Hero (Chrome)

4   31   31  

laravel-scrapingbee

A PHP Laravel Library for Scrapingbee Web Scraping API

5   30   30  

permaculture

Permaculture design app built on scraped plant databases. Drag-n-drop...

5   30   30  

m2m

Transform a Medium post into a Markdown file

3   30   30  

ferret-server

Advanced declarative web scraping

6   30   30  

proxy-db

Manage free and private proxies on local db for Python Projects

7   30   30  

browser-automation-api

Browser automation API for repetitive web-based tasks, with a friendly...

4   30   30  

Python-scraper-tutorial

A short introduction to scraping with Python with given steps and an e...

4   30   30  

habr-observer

An automatically updated feed with summaries of the best Habr.com arti...

2   30   30  

tiktok-comment-scrapper

Get all comments from tiktok video url or id

10   30   30  

crawlee-one

Professional scrapers that provide full control to the users. Crawlee...

2   30   30  

tagalog-dictionary-scraper

Builds a Tagalog dictionary by collecting Tagalog words from tagalog.p...

15   29   29  

chromedl

Go library for scraping or downloading files bypassing Cloudflare prot...

2   29   29  

FirstCyclingAPI

An unofficial Python API wrapper for firstcycling.com

4   29   29  

naos

📉 Uptime and error monitoring CLI

1   29   29  

insta-scrape

Scrape Instagram

13   29   29