scraping

Cloudflare Turnstile solver & bypass — Python, real Chrome browser, no paid APIs. Local HTTP API service included. Auto-solves invisible and managed (...

Automate your LinkedIn Outreach with Selenium and GeckoDriver.

a golang library and webserver for fast TCP & TLS fingerprinting, powered by eBPF

Deals Scraper is a Canadian tool to find good deals on websites like Facebook Marketplace, Kijiji, Ebay, Amazon and Lespacs

Application for scraping, analyzing and visualizing rental listings in Austria

🕵‍♂ Bot detection tests for Puppeteer. Hide and seek!

A powerful open-source proxy scraper

Official Oxylabs MCP integration

An app to search startup jobs scraped from websites written in Elixir, Phoenix, React and styled-components.

Automatically save transactions from all major Israeli banks and credit card companies, using GitHub actions (or a self hosted docker image)

Turn any developer documentation into a GPT

A drop-in replacement for playwright-python patched with rebrowser-patches. It allows to pass modern automation detection tests.

Website scraper for getting invoices automagically as pdf (useful for taxes or DMS)

使 scrapy 开发不用在意 item，pipeline，middleware 等通用场景下模块的编写，解放开发者的双手。

Crawl sites for RSS, Atom, and JSON feeds.

Draco is a faster, cheaper and lighter firecrawl drop-in replacement that you own entirely, running on your machine, with a built in MCP, free websear...

Updated python-beginners docs and examples

Apify API client for Python—Programmatically run Actors, manage and stream data from storages (datasets, key-value stores, request queues), schedule a...

爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer

Easily download anonymous Github repositories from https://anonymous.4open.science/ with a GUI interface

A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright...

A Flexible Rust Crate for DOM Querying and Manipulation

REST API streaming dan download Anime subtitle Indonesia | sub Indo

This whitepaper describes a new concept for building serverless microapps called Actors, which are easy to develop, share, integrate, and build upon....

An infinite Pinterest crawler/scraper. Crawl image with inifnite-scroll!

A curated list of AI-powered web scraping tools, LLM-friendly crawlers, MCP servers, and infrastructure for turning the web into data.

Scrape and parse search engine results using SerpApi.

The library provides convenient access to the Outscraper API from applications written in the Python language. Allows using Outscraper's services from...

:spider: The PHP SERP Spider - A search engine scraper

The most comprehensive cryptocurrency API. Real-time prices, OHLCV, order books & market cap for 10,000+ tokens across 500+ exchanges. DeFi TVL, yield...

Newser is a simple utility to generate a pdf with you favorite news articles

A open source tool for collating publically available contact information for businesses.

PHP Library for detecting CMS

OCaml functional web scraping library

Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blo...

A script that can be used to capture various porn novels for machine learning / 一个可以用于抓取各类色情小说用于机器学习的脚本

ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different website...

Scape top GitHub repositories and users based on keywords

extract data from html table

Plugin based RSS feed generator for sites that don't offer any. Serves RSS, Atom and JSON Feeds.

Scraping and listing text and image searches on Google, Bing, DuckDuckGo, Baidu, Yahoo japan.

legacy backend for Open States

Powerful Google Maps Crawler / Scraper tool with REST API, Docker support & multi-format export

Web tasks that compile. Other browser tools tell your AI agent the click worked. chrome-agent reads the page back after every action and answers in JS...

Amazon products scraper with using of rotating proxies and headless Chrome from ScrapingAnt

Extract structured data from Shopify websites.

Python tool that automatically create outlook account with auto-captcha

Simplifique sua busca por emprego. Todas as oportunidades do mercado reunidas em uma plataforma inteligente e automatizada.

Одиннадцать маркетплейсов как MCP-серверы: Wildberries, Ozon, Яндекс Маркет, Детский мир, Авито, AliExpress, Taobao, Мегамаркет, Lamoda, DNS, Ситилинк...

Official Python SDK for the ScrapeGraph AI API. Smart scraping, search, crawling, markdownify, agentic browser automation, scheduled jobs, and s...