Most popular scraping repositories and open source projects

LInkedIn-Reverese-Lookup

🔎Search LinkedIn profile by email address📧

7   35   35  

facebook-discussion-tk

A collection of tools to (semi-)automatically collect and analyze data...

6   34   34  

Crawling-Emails

Very simple bash script to crawl email addresses from a specific websi...

16   34   34  

gwaripper

Tool for conveniently downloading audios from r/gonewildaudio and simi...

5   34   34  

BSCWhalesMonitor

BSC whales monitor and detector written in Python.

18   34   34  

cinemaempoa

Site que agrega filmes em cartaz em algumas das diversas salas de cine...

16   34   34  

bbb

Browser Bot Bookmarklet

0   34   34  

python-vistopia

看理想 Python 客户端 / 下载器，下载看理想的音频和文稿

10   34   34  

fastProxy

MultiThreaded Application to Scrape Working Web Proxies

10   33   33  

api-flight.com

Main API Flight Git Repository

9   33   33  

jmd_imagescraper

Image scraping library for creating deep learning datasets

15   33   33  

PastebinScrapy

Threat hunting tool for scraping latest scrapes from Pastebin

14   33   33  

vogue-runway-scraper

This application was built to help scrape the fashion looks from diffe...

4   33   33  

ioweb

Web Scraping Framework

11   33   33  

emec-api

API Python para consulta na base de dados oficial do e-MEC

12   33   33  

AniSync

Mapping sites to AniList and back.

6   32   32  

midjourney-gallery-downloader

Download Midjourney Showcase images automatically

10   32   32  

Filmweb2Letterboxd

Eksport ocen z Filmweb'u do pliku csv w formacie akceptowanym przez im...

1   32   32  

facebook-page-info-scraper

Free Facebook pages MetaData Scraping Library - Unlimited Calls

5   32   32  

strigil

Strigil is an OSINT tool for collecting and aggregating social media d...

5   32   32  

proxi

Proxy pool. Finds and checks proxies with rest api for querying result...

4   32   32  

video-crawler

Crawl websites for videos from Youtube, Vimeo, Soundcloud, etc

5   32   32  

serritor

Serritor is an open source web crawler framework built upon Selenium a...

14   32   32  

fb-event-scraper

Recursively scrape facebook events

3   32   32  

google-search-results-nodejs

Scrape and parse Google search results in Node.JS

3   32   32  

zoominfo_scraper

Zoominfo scraper with using of rotating proxies and headless Chrome fr...

9   32   32  

Thar

Mining all surnames used in Nepal.

9   31   31  

spidyquotes

Example site for web scraping tutorials

18   31   31  

htmlspitter

NodeJS server to spit out HTML from loaded JS using Puppeteer

6   31   31  

Scrapping

Mastering the art of scrapping 🎓

38   31   31  

facebook-snooper

Scrapes Facebook profile pages using a normal login (without an API ke...

7   31   31  

google-search-results-python

Scrape and parse Google search results in Python

9   31   31  

local-api-client-csharp

This .NET Standard package provides convenient access to the Local API...

2   31   31  

headless-task-server

A headless browser task/job queue & runner based on Hero (Chrome)

4   31   31  

google-search-scraper

TypeScript library for Google search scraping using http requests with...

11   31   31  

habr-observer

An automatically updated feed with summaries of the best Habr.com arti...

2   30   30  

tiktok-comment-scrapper

Get all comments from tiktok video url or id

10   30   30  

crawlee-one

Professional scrapers that provide full control to the users. Crawlee...

2   30   30  

m2m

Transform a Medium post into a Markdown file

3   30   30  

ferret-server

Advanced declarative web scraping

6   30   30  

proxy-db

Manage free and private proxies on local db for Python Projects

7   30   30  

browser-automation-api

Browser automation API for repetitive web-based tasks, with a friendly...

4   30   30  

Python-scraper-tutorial

A short introduction to scraping with Python with given steps and an e...

4   30   30  

laravel-scrapingbee

A PHP Laravel Library for Scrapingbee Web Scraping API

5   30   30  

permaculture

Permaculture design app built on scraped plant databases. Drag-n-drop...

5   30   30  

chromedl

Go library for scraping or downloading files bypassing Cloudflare prot...

2   29   29  

FirstCyclingAPI

An unofficial Python API wrapper for firstcycling.com

4   29   29  

tagalog-dictionary-scraper

Builds a Tagalog dictionary by collecting Tagalog words from tagalog.p...

15   29   29  

naos

📉 Uptime and error monitoring CLI

1   29   29  

insta-scrape

Scrape Instagram

13   29   29