Most popular scraping repositories and open source projects

SneakerBot mridulghanshala Python

Buy limited edition sneakers

35 9 35

LInkedIn-Reverese-Lookup harsha-iiiv JavaScript

🔎Search LinkedIn profile by email address📧

35 7 35

facebook-discussion-tk internaut Python

A collection of tools to (semi-)automatically collect and analyze data from online discussions on Facebook groups and pages.

34 6 34

cinemaempoa cumbucadev CSS

Site que agrega filmes em cartaz em algumas das diversas salas de cinema de Porto Alegre.

34 16 34

python-vistopia chazeon Python

看理想 Python 客户端 / 下载器，下载看理想的音频和文稿

34 10 34

bbb Fedia Svelte

Browser Bot Bookmarklet

34 0 34

Crawling-Emails pH-7 Shell

Very simple bash script to crawl email addresses from a specific website.

34 16 34

BSCWhalesMonitor alessio-ds Python

BSC whales monitor and detector written in Python.

34 18 34

video-crawler garysieling Scala

Crawl websites for videos from Youtube, Vimeo, Soundcloud, etc

33 5 33

api-flight.com fgparamio HTML

Main API Flight Git Repository

33 9 33

jmd_imagescraper joedockrill Jupyter Notebook

Image scraping library for creating deep learning datasets

33 15 33

PastebinScrapy apurvsinghgautam Python

Threat hunting tool for scraping latest scrapes from Pastebin

33 14 33

fastProxy 1UC1F3R616 Python

MultiThreaded Application to Scrape Working Web Proxies

33 10 33

emec-api pavanad Python

API Python para consulta na base de dados oficial do e-MEC

33 12 33

vogue-runway-scraper R-K-H JavaScript

This application was built to help scrape the fashion looks from different shows.

33 4 33

ioweb lorien Python

Web Scraping Framework

33 11 33

strigil stebbins Ruby

Strigil is an OSINT tool for collecting and aggregating social media data

32 5 32

proxi nicksherron Go

Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.

32 4 32

Filmweb2Letterboxd JSerwatka JavaScript

Eksport ocen z Filmweb'u do pliku csv w formacie akceptowanym przez importer Letterboxd

32 1 32

midjourney-gallery-downloader gotlougit Python

Download Midjourney Showcase images automatically

32 10 32

serritor peterbencze Java

Serritor is an open source web crawler framework built upon Selenium and written in Java. It can be used to crawl dynamic web pages that require JavaS...

32 14 32

fb-event-scraper pipriles Python

Recursively scrape facebook events

32 3 32

AniSync Eltik TypeScript

Mapping sites to AniList and back.

32 6 32

facebook-page-info-scraper wael-sudo2 Python

Free Facebook pages MetaData Scraping Library - Unlimited Calls

32 5 32

google-search-results-nodejs serpwow JavaScript

Scrape and parse Google search results in Node.JS

32 3 32

zoominfo_scraper ScrapingAnt Python

Zoominfo scraper with using of rotating proxies and headless Chrome from ScrapingAnt

32 9 32

Thar amitness

Mining all surnames used in Nepal.

31 9 31

spidyquotes zytedata Julia

Example site for web scraping tutorials

31 18 31

htmlspitter qdm12 TypeScript

NodeJS server to spit out HTML from loaded JS using Puppeteer

31 6 31

Scrapping ab-anand Python

Mastering the art of scrapping 🎓

31 38 31

facebook-snooper gsscoder Python

Scrapes Facebook profile pages using a normal login (without an API key)

31 7 31

google-search-results-python serpwow Python

Scrape and parse Google search results in Python

31 9 31

local-api-client-csharp kameleo-io C#

This .NET Standard package provides convenient access to the Local API REST interface of the Kameleo Client.

31 2 31

headless-task-server luka-dev TypeScript

A headless browser task/job queue & runner based on Hero (Chrome)

31 4 31

google-search-scraper tkattkat TypeScript

TypeScript library for Google search scraping using http requests with proxy support, pagination, and regional customization. Built for web scraping a...

31 11 31

crawlee-one JuroOravec TypeScript

Professional scrapers that provide full control to the users. Crawlee One builds on top of Crawlee and Apify and extends them with features for robust...

30 2 30

m2m imteekay Python

Transform a Medium post into a Markdown file

30 3 30

ferret-server MontFerret Go

Advanced declarative web scraping

30 6 30

proxy-db Nekmo Python

Manage free and private proxies on local db for Python Projects

30 7 30

browser-automation-api Agenty JavaScript

Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like c...

30 4 30