Topic

scraping

Repositories (1849)

ProductHunt-scraper
ProductHunt-scraper fernandod1 Python

Producthunt.com famous website scraper script. Scrap all offers and save in spreadsheet excel file.

34
deepstate-map-data
deepstate-map-data cyterat Jupyter Notebook

DeepState Map | Occupied | GeoJSON Multipolygon | Daily update

34
ted-scraper
ted-scraper corralm Python

🎙️ TED Talks web scraper

34
MTGA_Swapper
MTGA_Swapper BobJr23 Python

Edit, Swap, or Export any assets in MTG Arena (Sleeves, Card Art, Battlefield, Emotes, Pets). Unlock any card styles, including Spiderman cards

34
LeadGen
LeadGen FujiwaraChoki Python

This program uses a GoLang Google Maps Scraper to scrape Google Maps for places and then scrapes the email for each place based on their website.

34
node-red-contrib-nbrowser
node-red-contrib-nbrowser Steveorevo HTML

Provides a virtual web browser (a.k.a. "headless browser") appearing as a node.

33
proxi
proxi nicksherron Go

Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.

33
Scrapping
Scrapping ab-anand Python

Mastering the art of scrapping 🎓

33
fb-event-scraper
fb-event-scraper pipriles Python

Recursively scrape facebook events

33
browser-automation-api
browser-automation-api Agenty JavaScript

Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like c...

33
ioweb
ioweb lorien Python

Web Scraping Framework

33
Crawling-Emails
Crawling-Emails pH-7 Shell

Very simple bash script to crawl email addresses from a specific website.

33
skyscanner-flights-scraping
skyscanner-flights-scraping TheJoin95 JavaScript

A scraping tool (for personal use, not commercial) to get some information about flights

33
FirstCyclingAPI
FirstCyclingAPI baronet2 Python

An unofficial Python API wrapper for firstcycling.com

33
pastebin-bisque
pastebin-bisque bbbbbrie Python

Download all of a given user's public Pastebin pastes

33
bbb
bbb Fedia Svelte

Browser Bot Bookmarklet

33
fastProxy
fastProxy searchformyusername Python

MultiThreaded Application to Scrape Working Web Proxies

33
tagalog-dictionary-scraper
tagalog-dictionary-scraper raymelon Python

2016: Builds a Tagalog dictionary by collecting Tagalog words from tagalog.pinoydictionary.com

33
SearchEnginesBookmarklet
SearchEnginesBookmarklet medialab JavaScript

Extract list of results from search engines pages as CSV with a bookmarklet directly within the browser

33
Thar
Thar amitness

Mining all surnames used in Nepal.

32
strigil
strigil stebbins Ruby

Strigil is an OSINT tool for collecting and aggregating social media data

32
video-crawler
video-crawler garysieling Scala

Crawl websites for videos from Youtube, Vimeo, Soundcloud, etc

32
htmlspitter
htmlspitter qdm12 TypeScript

NodeJS server to spit out HTML from loaded JS using Puppeteer

32
scraping-berita
scraping-berita bagusindrayana JavaScript

scraping berita dari beberapa portal berita indonesia

32
Web-Scraping-API
Web-Scraping-API Decodo JavaScript

Web Scraping API code examples for Python, PHP and Node.js

32
google-search-results-nodejs
google-search-results-nodejs serpwow JavaScript

Scrape and parse Google search results in Node.JS

32
AniSync
AniSync Eltik TypeScript

Mapping sites to AniList and back.

32
m3u-audiobooks
m3u-audiobooks junguler HTML

collection of 100k+ audio books, radio porgrams, music etc from archive.org in a easy to listen m3u playlist format

32
froxy
froxy matheusfelipeog Python

Hide your IP with free proxies using Froxy 🔄

32
vogue-runway-scraper
vogue-runway-scraper R-K-H JavaScript

This application was built to help scrape the fashion looks from different shows.

32
midjourney-gallery-downloader
midjourney-gallery-downloader gotlougit Python

Download Midjourney Showcase images automatically

32
bet365_web_scraping
bet365_web_scraping hansalemaos Python

Ainda tem como raspar dados do site bet365.com - tutorial educacional (SeleniumBase / ADB) - 2023

32
telegram-story-scraper
telegram-story-scraper robertaitch Python

A Python script that allows you to automatically scrape and download stories from your Telegram friends using the Telethon library. The script continu...

32
hShop-downloader
hShop-downloader Ghost0159 Python

A python script to download all hShop content

32
spidyquotes
spidyquotes zytedata Julia

Example site for web scraping tutorials

31
m2m
m2m imteekay Python

Transform a Medium post into a Markdown file

31
duckduckgo
duckduckgo its0x08 Python

A simple DuckDuckGo URL scraper.

31
proxy-db
proxy-db Nekmo Python

Manage free and private proxies on local db for Python Projects

31
local-api-client-csharp
local-api-client-csharp kameleo-io C#

This .NET Standard package provides convenient access to the Local API REST interface of the Kameleo Client.

31
facebook-snooper
facebook-snooper gsscoder Python

Scrapes Facebook profile pages using a normal login (without an API key)

31
google-search-results-python
google-search-results-python serpwow Python

Scrape and parse Google search results in Python

31
MotoGP-API
MotoGP-API ParsaD23 Java

MotoGP Api: Library that reads the results of the MotoGP, 500cc, Moto2 and Moto3 classes from a website.

31
free-proxy-health-list
free-proxy-health-list xyzs996 Python

Free proxy list by country: verified SOCKS5, SOCKS4, HTTP and HTTPS proxies, rechecked every 30 minutes, as TXT, JSON and CSV.

31
habr-observer
habr-observer pltnk Go

An automatically updated feed with summaries of the best Habr.com articles generated by the YandexGPT neural network.

31
Instagram-Network_scraping_and_analysis
Instagram-Network_scraping_and_analysis Arjun-Siva Jupyter Notebook

Python script to scrape Instagram network

30
locations
locations stiles Jupyter Notebook

An expanding collection of data scrapers designed to gather location details on prominent stores, restaurants and other consumer destinations across t...

30
google-images-scraper
google-images-scraper pruthvik-sheth Python

Google images scrapper in full resolution with multi threading speed.

30
dramabox-scraper
dramabox-scraper giienew JavaScript

Dramabox Scraper ( Original Apps Latest Version)

30
serpapi-golang
serpapi-golang serpapi Go

Official Golang wrapper for SerpApi HTTP endpoints

30
supa-crawl-chat
supa-crawl-chat bigsk1 Python

Integrates Supabase with Crawl4AI and AI Chat to create a powerful web crawling and semantic search solution. Streamlit supabase data visualization. R...

30