Topic

scraping

Repositories (1766)

Crawling-Emails
Crawling-Emails pH-7 Shell

Very simple bash script to crawl email addresses from a specific website.

33
ioweb
ioweb lorien Python

Web Scraping Framework

33
serritor
serritor peterbencze Java

Serritor is an open source web crawler framework built upon Selenium and written in Java. It can be used to crawl dynamic web pages that require JavaS...

33
fb-event-scraper
fb-event-scraper pipriles Python

Recursively scrape facebook events

33
BSCWhalesMonitor
BSCWhalesMonitor alessio-ds Python

BSC whales monitor and detector written in Python.

33
proxi
proxi nicksherron Go

Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.

33
pastebin-bisque
pastebin-bisque bbbbbrie Python

Download all of a given user's public Pastebin pastes

33
bbb
bbb Fedia Svelte

Browser Bot Bookmarklet

33
ETF-Scraper
ETF-Scraper nikulpatel3141 Python

Scrape public ETF and Mutual Fund holdings information

33
substack_scraper
substack_scraper bytewife Rust

A scraper for Substack article text content

33
ProductHunt-scraper
ProductHunt-scraper fernandod1 Python

Producthunt.com famous website scraper script. Scrap all offers and save in spreadsheet excel file.

32
htmlspitter
htmlspitter qdm12 TypeScript

NodeJS server to spit out HTML from loaded JS using Puppeteer

32
facebook-snooper
facebook-snooper gsscoder Python

Scrapes Facebook profile pages using a normal login (without an API key)

32
google-search-results-nodejs
google-search-results-nodejs serpwow JavaScript

Scrape and parse Google search results in Node.JS

32
bet365_web_scraping
bet365_web_scraping hansalemaos Python

Ainda tem como raspar dados do site bet365.com - tutorial educacional (SeleniumBase / ADB) - 2023

32
tagalog-dictionary-scraper
tagalog-dictionary-scraper raymelon Python

Builds a Tagalog dictionary by collecting Tagalog words from tagalog.pinoydictionary.com

32
strigil
strigil stebbins Ruby

Strigil is an OSINT tool for collecting and aggregating social media data

32
AniSync
AniSync Eltik TypeScript

Mapping sites to AniList and back.

32
Thar
Thar amitness

Mining all surnames used in Nepal.

32
Scrapping
Scrapping ab-anand Python

Mastering the art of scrapping 🎓

32
browser-automation-api
browser-automation-api Agenty JavaScript

Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like c...

32
python-web-scrapping
python-web-scrapping sallamy2580 Python

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC,...

32
video-crawler
video-crawler garysieling Scala

Crawl websites for videos from Youtube, Vimeo, Soundcloud, etc

32
LeadGen
LeadGen FujiwaraChoki Python

This program uses a GoLang Google Maps Scraper to scrape Google Maps for places and then scrapes the email for each place based on their website.

32
Kemono-Scraper
Kemono-Scraper 3dnsfw TypeScript

UPDATED 2026: Kemono / Coomer Scraper / Downloader / Auto-Retry / Compression

32
m2m
m2m imteekay Python

Transform a Medium post into a Markdown file

31
TweetScraperR
TweetScraperR agusnieto77 R

Este paquete proporciona funciones para extraer datos de X/Twitter, incluidos tweets, usuarixs y metadatos asociados sin necesidad de usar API. || Thi...

31
local-api-client-csharp
local-api-client-csharp kameleo-io C#

This .NET Standard package provides convenient access to the Local API REST interface of the Kameleo Client.

31
scraping_zap_imoveis
scraping_zap_imoveis ziggy-data Python

Faz web scraping no site Zap-Imoveis, ETL, RegEx, análise de dados, dashboard e modelo preditivo.

31
midjourney-gallery-downloader
midjourney-gallery-downloader gotlougit Python

Download Midjourney Showcase images automatically

31
spidyquotes
spidyquotes zytedata Julia

Example site for web scraping tutorials

31
duckduckgo
duckduckgo its0x08 Python

A simple DuckDuckGo URL scraper.

31
everand-downloader
everand-downloader CrazyCoder76 Python

This is everand book downloader

31
google-search-results-python
google-search-results-python serpwow Python

Scrape and parse Google search results in Python

31
habr-observer
habr-observer pltnk Python

An automatically updated feed with summaries of the best Habr.com articles generated by the YandexGPT neural network.

31
vogue-runway-scraper
vogue-runway-scraper R-K-H JavaScript

This application was built to help scrape the fashion looks from different shows.

31
skyscanner-flights-scraping
skyscanner-flights-scraping TheJoin95 JavaScript

A scraping tool (for personal use, not commercial) to get some information about flights

31
ferret-server
ferret-server MontFerret Go

Advanced declarative web scraping

30
SearchEnginesBookmarklet
SearchEnginesBookmarklet medialab JavaScript

Extract list of results from search engines pages as CSV with a bookmarklet directly within the browser

30
Instagram-Network_scraping_and_analysis
Instagram-Network_scraping_and_analysis Arjun-Siva Jupyter Notebook

Python script to scrape Instagram network

30
locations
locations stiles Jupyter Notebook

An expanding collection of data scrapers designed to gather location details on prominent stores, restaurants and other consumer destinations across t...

30
Scraper-Projects
Scraper-Projects amrrs HTML

🕸 List of mini projects that involve web scraping 🕸

30
proxy-db
proxy-db Nekmo Python

Manage free and private proxies on local db for Python Projects

30
froxy
froxy matheusfelipeog Python

Hide your IP with free proxies using Froxy 🔄

30
scraping-berita
scraping-berita bagusindrayana JavaScript

scraping berita dari beberapa portal berita indonesia

30
dmi-instascraper
dmi-instascraper digitalmethodsinitiative Python

A GUI for Instaloader to scrape users and hashtags with on Instagram

29
board-game-scraper
board-game-scraper recommend-games Python

Board game data scraper

29
Google-Web-Scraper
Google-Web-Scraper AgentANAKIN Python

This Python code scrapes Google search results then applies sentiment analysis, generates text summaries, and ranks keywords.

29
ferenda
ferenda staffanm HTML

Transform unstructured document collections to structured Linked Data

29
scrape_discord
scrape_discord ArvinJA Python

Scrape discord channels

29