Topic

scraping

Repositories (1816)

strigil
strigil stebbins Ruby

Strigil is an OSINT tool for collecting and aggregating social media data

32
tagalog-dictionary-scraper
tagalog-dictionary-scraper raymelon Python

Builds a Tagalog dictionary by collecting Tagalog words from tagalog.pinoydictionary.com

32
AniSync
AniSync Eltik TypeScript

Mapping sites to AniList and back.

32
midjourney-gallery-downloader
midjourney-gallery-downloader gotlougit Python

Download Midjourney Showcase images automatically

32
video-crawler
video-crawler garysieling Scala

Crawl websites for videos from Youtube, Vimeo, Soundcloud, etc

32
htmlspitter
htmlspitter qdm12 TypeScript

NodeJS server to spit out HTML from loaded JS using Puppeteer

32
google-search-results-nodejs
google-search-results-nodejs serpwow JavaScript

Scrape and parse Google search results in Node.JS

32
python-web-scrapping
python-web-scrapping sallamy2580 Python

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC,...

32
m2m
m2m imteekay Python

Transform a Medium post into a Markdown file

31
MTGA_Swapper
MTGA_Swapper BobJr23 Python

Edit, Swap, or Export any assets in MTG Arena (Sleeves, Card Art, Battlefield, Emotes, Pets). Unlock any card styles, including Spiderman cards

31
skyscanner-flights-scraping
skyscanner-flights-scraping TheJoin95 JavaScript

A scraping tool (for personal use, not commercial) to get some information about flights

31
google-search-results-python
google-search-results-python serpwow Python

Scrape and parse Google search results in Python

31
MotoGP-API
MotoGP-API ParsaD23 Java

MotoGP Api: Library that reads the results of the MotoGP, 500cc, Moto2 and Moto3 classes from a website.

31
TweetScraperR
TweetScraperR agusnieto77 R

Este paquete proporciona funciones para extraer datos de X/Twitter, incluidos tweets, usuarixs y metadatos asociados sin necesidad de usar API. || Thi...

31
spidyquotes
spidyquotes zytedata Julia

Example site for web scraping tutorials

31
vogue-runway-scraper
vogue-runway-scraper R-K-H JavaScript

This application was built to help scrape the fashion looks from different shows.

31
local-api-client-csharp
local-api-client-csharp kameleo-io C#

This .NET Standard package provides convenient access to the Local API REST interface of the Kameleo Client.

31
froxy
froxy matheusfelipeog Python

Hide your IP with free proxies using Froxy 🔄

31
duckduckgo
duckduckgo its0x08 Python

A simple DuckDuckGo URL scraper.

31
scraping-berita
scraping-berita bagusindrayana JavaScript

scraping berita dari beberapa portal berita indonesia

31
proxy-db
proxy-db Nekmo Python

Manage free and private proxies on local db for Python Projects

31
habr-observer
habr-observer pltnk Go

An automatically updated feed with summaries of the best Habr.com articles generated by the YandexGPT neural network.

31
Scraper-Projects
Scraper-Projects amrrs HTML

🕸 List of mini projects that involve web scraping 🕸

30
google-images-scraper
google-images-scraper pruthvik-sheth Python

Google images scrapper in full resolution with multi threading speed.

30
locations
locations stiles Jupyter Notebook

An expanding collection of data scrapers designed to gather location details on prominent stores, restaurants and other consumer destinations across t...

30
Instagram-Network_scraping_and_analysis
Instagram-Network_scraping_and_analysis Arjun-Siva Jupyter Notebook

Python script to scrape Instagram network

30
supa-crawl-chat
supa-crawl-chat bigsk1 Python

Integrates Supabase with Crawl4AI and AI Chat to create a powerful web crawling and semantic search solution. Streamlit supabase data visualization. R...

30
SearchEnginesBookmarklet
SearchEnginesBookmarklet medialab JavaScript

Extract list of results from search engines pages as CSV with a bookmarklet directly within the browser

30
ferenda
ferenda staffanm HTML

Transform unstructured document collections to structured Linked Data

30
ferret-server
ferret-server MontFerret Go

Advanced declarative web scraping

30
Web-Scraping-API
Web-Scraping-API Decodo JavaScript

Web Scraping API code examples for Python, PHP and Node.js

30
naos
naos theolampert TypeScript

📉 Uptime and error monitoring CLI

29
scrap
scrap victorqribeiro JavaScript

Scrapping Facebook with JavaScript.

29
hShop-downloader
hShop-downloader Ghost0159 Python

A python script to download all hShop content

29
emailscraper
emailscraper lawzava Go

Minimalistic library to scrape emails from websites with headless browser support.

29
dmi-instascraper
dmi-instascraper digitalmethodsinitiative Python

A GUI for Instaloader to scrape users and hashtags with on Instagram

29
telegram-story-scraper
telegram-story-scraper robertaitch Python

A Python script that allows you to automatically scrape and download stories from your Telegram friends using the Telethon library. The script continu...

29
pickall
pickall gsscoder C#

.NET agile and extensible web searching API

29
Social-Media-Scraping-API
Social-Media-Scraping-API Decodo PHP

Social Media Scraping API code examples for Python, PHP and Node.js

29
board-game-scraper
board-game-scraper recommend-games Python

Board game data scraper

29
arvancloud-bypass
arvancloud-bypass NabiKAZ JavaScript

Node.js library to bypass ArvanCloud CDN JavaScript challenges without a browser

29
insta-scrape
insta-scrape ScriptSmith

Scrape Instagram

29
m3u-audiobooks
m3u-audiobooks junguler HTML

collection of 100k+ audio books, radio porgrams, music etc from archive.org in a easy to listen m3u playlist format

29
scrapeadvisor
scrapeadvisor 0x0be Python

A user-friendly python-based GUI which provides sentiment analysis of users' reviews toward a specific TripAdvisor facility

29
scrape_discord
scrape_discord ArvinJA Python

Scrape discord channels

29
helix-importer-ui
helix-importer-ui adobe JavaScript
29
Iranian-politicians-twitter-dataset-persian
Iranian-politicians-twitter-dataset-persian miladfa7 Jupyter Notebook

Iranian politicians twitter dataset persian | دیتاست کامل توییت های سیاسیون ایرانی در توییتر برای کارهای پردازش متن

28
zona-prop-scraper
zona-prop-scraper Sotrosca Python

Scraper de Zonaprop

28
html2rss-configs
html2rss-configs html2rss Ruby

📇 A collection of html2rss feed configs.

28
Reddit-Content-Research-Agent
Reddit-Content-Research-Agent codingforentrepreneurs Python

Build a Reddit Content Research Agent with LLMs, LangChain, SERP, Jupyter, Django, Bright Data, Celery, Django QStash, and much more.

28