Topic

scraping

Repositories (1766)

israeli-supermarket-scarpers
israeli-supermarket-scarpers OpenIsraeliSupermarkets Jupyter Notebook

A python package with client to scrape the israeli supermarkets data

34
fastProxy
fastProxy searchformyusername Python

MultiThreaded Application to Scrape Working Web Proxies

34
fb-event-scraper
fb-event-scraper pipriles Python

Recursively scrape facebook events

33
BSCWhalesMonitor
BSCWhalesMonitor alessio-ds Python

BSC whales monitor and detector written in Python.

33
Crawling-Emails
Crawling-Emails pH-7 Shell

Very simple bash script to crawl email addresses from a specific website.

33
ioweb
ioweb lorien Python

Web Scraping Framework

33
pastebin-bisque
pastebin-bisque bbbbbrie Python

Download all of a given user's public Pastebin pastes

33
KOLscan-leaderboard-scraping
KOLscan-leaderboard-scraping marksantiago290 Python

Python-based web scraper that extracts cryptocurrency trader performance data from KOLscan's leaderboard.

33
proxi
proxi nicksherron Go

Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.

33
substack_scraper
substack_scraper bytewife Rust

A scraper for Substack article text content

33
serritor
serritor peterbencze Java

Serritor is an open source web crawler framework built upon Selenium and written in Java. It can be used to crawl dynamic web pages that require JavaS...

33
bbb
bbb Fedia Svelte

Browser Bot Bookmarklet

33
Kemono-Scraper
Kemono-Scraper 3dnsfw TypeScript

UPDATED 2026: Kemono / Coomer Scraper / Downloader / Auto-Retry / Compression

32
browser-automation-api
browser-automation-api Agenty JavaScript

Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like c...

32
facebook-snooper
facebook-snooper gsscoder Python

Scrapes Facebook profile pages using a normal login (without an API key)

32
google-search-results-nodejs
google-search-results-nodejs serpwow JavaScript

Scrape and parse Google search results in Node.JS

32
python-web-scrapping
python-web-scrapping sallamy2580 Python

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC,...

32
AniSync
AniSync Eltik TypeScript

Mapping sites to AniList and back.

32
Thar
Thar amitness

Mining all surnames used in Nepal.

32
strigil
strigil stebbins Ruby

Strigil is an OSINT tool for collecting and aggregating social media data

32
video-crawler
video-crawler garysieling Scala

Crawl websites for videos from Youtube, Vimeo, Soundcloud, etc

32
htmlspitter
htmlspitter qdm12 TypeScript

NodeJS server to spit out HTML from loaded JS using Puppeteer

32
Scrapping
Scrapping ab-anand Python

Mastering the art of scrapping 🎓

32
LeadGen
LeadGen FujiwaraChoki Python

This program uses a GoLang Google Maps Scraper to scrape Google Maps for places and then scrapes the email for each place based on their website.

32
bet365_web_scraping
bet365_web_scraping hansalemaos Python

Ainda tem como raspar dados do site bet365.com - tutorial educacional (SeleniumBase / ADB) - 2023

32
tagalog-dictionary-scraper
tagalog-dictionary-scraper raymelon Python

Builds a Tagalog dictionary by collecting Tagalog words from tagalog.pinoydictionary.com

32
midjourney-gallery-downloader
midjourney-gallery-downloader gotlougit Python

Download Midjourney Showcase images automatically

31
google-search-results-python
google-search-results-python serpwow Python

Scrape and parse Google search results in Python

31
TweetScraperR
TweetScraperR agusnieto77 R

Este paquete proporciona funciones para extraer datos de X/Twitter, incluidos tweets, usuarixs y metadatos asociados sin necesidad de usar API. || Thi...

31
scraping_zap_imoveis
scraping_zap_imoveis ziggy-data Python

Faz web scraping no site Zap-Imoveis, ETL, RegEx, análise de dados, dashboard e modelo preditivo.

31
froxy
froxy matheusfelipeog Python

Hide your IP with free proxies using Froxy 🔄

31
skyscanner-flights-scraping
skyscanner-flights-scraping TheJoin95 JavaScript

A scraping tool (for personal use, not commercial) to get some information about flights

31
spidyquotes
spidyquotes zytedata Julia

Example site for web scraping tutorials

31
habr-observer
habr-observer pltnk Python

An automatically updated feed with summaries of the best Habr.com articles generated by the YandexGPT neural network.

31
duckduckgo
duckduckgo its0x08 Python

A simple DuckDuckGo URL scraper.

31
m2m
m2m imteekay Python

Transform a Medium post into a Markdown file

31
vogue-runway-scraper
vogue-runway-scraper R-K-H JavaScript

This application was built to help scrape the fashion looks from different shows.

31
local-api-client-csharp
local-api-client-csharp kameleo-io C#

This .NET Standard package provides convenient access to the Local API REST interface of the Kameleo Client.

31
scraping-berita
scraping-berita bagusindrayana JavaScript

scraping berita dari beberapa portal berita indonesia

30
supa-crawl-chat
supa-crawl-chat bigsk1 Python

Integrates Supabase with Crawl4AI and AI Chat to create a powerful web crawling and semantic search solution. Streamlit supabase data visualization. R...

30
SearchEnginesBookmarklet
SearchEnginesBookmarklet medialab JavaScript

Extract list of results from search engines pages as CSV with a bookmarklet directly within the browser

30
proxy-db
proxy-db Nekmo Python

Manage free and private proxies on local db for Python Projects

30
Scraper-Projects
Scraper-Projects amrrs HTML

🕸 List of mini projects that involve web scraping 🕸

30
ferret-server
ferret-server MontFerret Go

Advanced declarative web scraping

30
Instagram-Network_scraping_and_analysis
Instagram-Network_scraping_and_analysis Arjun-Siva Jupyter Notebook

Python script to scrape Instagram network

30
locations
locations stiles Jupyter Notebook

An expanding collection of data scrapers designed to gather location details on prominent stores, restaurants and other consumer destinations across t...

30
scrape_discord
scrape_discord ArvinJA Python

Scrape discord channels

29
Social-Media-Scraping-API
Social-Media-Scraping-API Decodo PHP

Social Media Scraping API code examples for Python, PHP and Node.js

29
scrapeadvisor
scrapeadvisor 0x0be Python

A user-friendly python-based GUI which provides sentiment analysis of users' reviews toward a specific TripAdvisor facility

29
pickall
pickall gsscoder C#

.NET agile and extensible web searching API

29