scraping
Repositories (1849)
Code examples and general information
Scrape structured data from HTML documents automatically
Telegram bot that downloads content from YouTube, Instagram and X (Twitter)
A 100% working Justdial scrapper, Just enter the url and it'll extract business info from it
SERP Scraping API code examples for Python, PHP and Node.js
Download crypto on-chain data with a single line of code
A tutorial for scraping Instagram profile information and posts using Scraping Fish API: https://scrapingfish.com
Automatically post Github trends on Facebook page
Scraping of 5 types of fuel :fuelpump: from 8 different fuelcompanies in Denmark :denmark:.
Stop getting 403 Forbidden. A specialized httpx-like toolkit for WAF evasion.
API for scrapping common 🇵🇱 meme sites
Xplore is a scraper for Twitter/X without using API in Rust.
Engine-independent TLS fingerprint library for Go — JA3/JA4, uTLS browser impersonation, byte-exact HTTP/2, curl_cffi-style HTTP client. Zero CGO.
A python library for scraping videos from JW Player
Official Python SDK for the Supadata API.
Transparent man-in-the-middle (MitM) proxy for the Chrome DevTools Protocol (CDP). Intercept, modify, inject, and filter messages and events between a...
ProxyCrawl PHP library for scraping and crawling websites
MCP server for Octen — real-time web search, broad multi-angle search, news, URL extraction, and image/video search for Claude Code, Cursor, and any M...
🎢RCDB non official Rest API created by scrape RCDB website.
🎰 Real-time monitoring system for 1xBet Crash game with WebSocket scraping, interactive dashboard, PostgreSQL storage, and Docker containerization.
search engine for python (Query and scrape search engines)
SDK to access Zenrows API directly from Python. We handle proxies rotation, headless browsers and CAPTCHAs for you.
Projet pour générer la page http://clementgrimal.fr/darwin/
node.js library for scraping GitHub trending repositories.
CLI tool for extracting URLs as Markdown
Api de cotizaciones basados en los datos publicados por la Dirección Nacional de Ingresos Tributarios (DNIT)
Web crawling & scraping framework for Node.js on top of headless Chrome browser
Plan, generate with AI, and auto-submit your university course schedule (KRS) without the drama. A zero-database tool connected live to your campus.
This API is built for lead generation and provides users with a streamlined platform for capturing and tracking leads, which integrates with existing...
🧩 Proposal to allow user scripts like "expand comments", "hide popups", "fill out this form", etc. to be reusable across pure browser environments, p...
A Python script that auto downloads all reels sent to your Instagram DM
🥷 Master the art of web scraping with JSON-powered workflows Define scrapes declaratively · Template everything · Run and monitor in style
Güncel Türkçe Sözlük'ün 12. baskısı, JSON ve MOBI formatında.
Open-source, fast, and scalable API for fetching public HLTV data. Updated monthly and fully extensible with Swagger-documented endpoints.
Get all the tweets from your favorite twitter accounts.
Easily download the main content of a web page in html, markdown, and/or epub format from command line.
Latest UserAgents Dumped Various Devices / Platforms
HasData MCP server for web scraping and search. Google Search, Maps, Amazon, Zillow, Airbnb, YouTube and 20 more sites as structured JSON, hosted over...
A Python-based web application that automates LinkedIn job scraping and provides an intelligent job management interface. It helps job seekers efficie...
Marketplace Scraping Tool for Amazon and Mercado Livre
A Selenium-driven tool for automated website interaction and scraping.
A simple contact info scraping tool written in Python and available as an executable file. It has a CLI & a GUI.
Includes data about over 250 NFT Collections
Collection of scripts to help with web based ctfs.
Scraping Facebook information
Google's Bard ChatBot Unofficial NodeJS API
Selenium Dynamic Website Scraping based on .NET & C#
A scraper application for crawling press releases of US government agencies and major think tanks for analytical purposes.
SDK for Scrapfly.io web scraping API
CHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages