scraping
Repositories (1766)
Scraping assistant tool. Editing and maintaining CSS/XPath selectors across webpages.
An Telegram Mass Members Adding/Scraping Tool Written In Python Using Pyrogram Library.
Detect bots, vision AI agents, and headless browsers through 40+ behavioral signals and SHA-256 proof of work. Self-hosted, privacy-first, and fully o...
htmlSQL is a experimental PHP library which allows you to access HTML values by an SQL like syntax.
Spiderbuf 是一个专注于 Python 爬虫练习的网站。提供丰富的爬虫教程、爬虫案例解析和爬虫练习题。Python爬虫开发强化练习，在矛与盾的攻防中不断提高技术水平，...
ASP.NET View State Decoder
A web crawling programming language
Automate your LinkedIn job applications with AI! This bot utilizes GPT models such as GPT-4, GPT-3.5, and Google's Gemini Pro for Easy Apply form fill...
This tutorial shows how to automate your web scraping processes using AutoScaper – one of Python web scraping libraries available.
The code used to create and update the Open Australian Legal Corpus, the first and only multijurisdictional open corpus of Australian legislative and...
🌱 goClone - clone websites in seconds
API ketersediaan rumah sakit dan tempat tidur rumah sakit untuk pasien covid-19 ataupun non-covid yang berada di Indonesia
An all-in-one scraper/downloader for Fansly written in go with the aid of A.I. Download content, Record lives, and Interact with post from your favori...
Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases:...
Search geolocations for (social) media posts in databases like Bellingcat, Cen4InfoRes etc.
Public Roadmap for SerpApi, LLC (https://serpapi.com)
⬇️ A simple all-in-one CLI tool to download EVERYTHING from a URL (like youtube-dl/yt-dlp, forum-dl, gallery-dl, simpler ArchiveBox). 🎭 Uses headless...
Web scraping using rust !
Scrapy + Puppeteer
qcrawl - fast async web crawling & scraping framework for Python.
Telegram CC Scrapper - Debit/Credit Card [channel public or private / group ]
A complimentary proxy to help to use SPM with headless browsers
Scraping the justETF
Torrengo is a CLI (command line) program written in Go which concurrently searches torrents from various sources.
Parse a human name string into salutation, first name, middle name, last name, suffix.
Application for scraping, analyzing and visualizing rental listings in Austria
Automate your LinkedIn Outreach with Selenium and GeckoDriver.
Website scraper for getting invoices automagically as pdf (useful for taxes or DMS)
🕵♂ Bot detection tests for Puppeteer. Hide and seek!
Turn any developer documentation into a GPT
A powerful open-source proxy scraper
Anti-detect browser for web scraping and automation. Engine-level fingerprint masking for Chromium and Firefox. Self-hosted, Docker-ready. Integrates...
An app to search startup jobs scraped from websites written in Elixir, Phoenix, React and styled-components.
HTTP client for Node.js with browser TLS fingerprint impersonation
Deals Scraper is a Canadian tool to find good deals on websites like Facebook Marketplace, Kijiji, Ebay, Amazon and Lespacs
Collect structured responses from a ChatGPT scraper by sending a prompt with valid ChatGPT scraping API credentials. Enable live search, inject HTML c...
An advanced tool for checking GitHub repositories, with star statistics, including fake star analysis and data visualization.
Updated python-beginners docs and examples
A drop-in replacement for playwright-python patched with rebrowser-patches. It allows to pass modern automation detection tests.
使 scrapy 开发不用在意 item，pipeline，middleware 等通用场景下模块的编写，解放开发者的双手。
A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright...
Site que agrega filmes em cartaz em algumas das diversas salas de cinema de Porto Alegre.
爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer
a golang library and webserver for fast TCP & TLS fingerprinting, powered by eBPF
Easily download anonymous Github repositories from https://anonymous.4open.science/ with a GUI interface
:spider: The PHP SERP Spider - A search engine scraper
Official Oxylabs MCP integration
Automatically save transactions from all major Israeli banks and credit card companies, using GitHub actions (or a self hosted docker image)
Crawl sites for RSS, Atom, and JSON feeds.