scraping

Stealth Chromium browser for web scraping and AI agents.

Spotify scraper

Run Selenium with Python via Github Actions using Headless or Non-Headless browsers!

A collection of intel and usernames scraped from various cybercrime sources & forums. DarkForums, HackForums, Patched, Cracked, BreachForums, OGUser,...

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [i...

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library des...

Web Data Scraper - no-code internet scraping. Extract and export to CSV, Excel, JSON, Google Sheets, and Webhook.

An implementation of Google Deep Search 🕵️ with support for 1000+ references, local inference, chatting with your scraping session using RAPTOR, and...

Get structured JSON data from any page.

A simple Node.js code to get public information and media from every Instagram post or reel URL without API. Working 2025

Pick the most common user-agents on the Internet 👻

Scraping statistics, predicting NBA player performance with neural networks and boosting algorithms, and optimising lineups for Draft Kings with gene...

Python scraper for Language Pods such as Japanesepod101.com :japanese_ogre: :japan: :sushi: Compatible with Japanese, Chinese, French, German, Italian...

Code relating to scraping public police data.

:spider: Google client for SERPS

Scraping the TikTok discovery web API every 15 minutes using Github Actions to view changes

The Apify SDK for Python is the official library for creating Apify Actors in Python. It provides useful features like actor lifecycle management, loc...

Hear local historical markers as you travel on your road-trip. 100% Shared Compose UI, Kotlin native cross-platform codebase. Includes Cocoapods, Goog...

Scrape Algorithm Questions from leetcode and generate html and epub file

Model Context Protocol server that integrates AgentQL's data extraction capabilities.

Extract data or evaluate value from HTML/XML documents using XPath

Generate dispersable airdrops from Twitter threads.

API to get enormous amount of high resolution satellite images from satellites.pro quickly through multi-threading! create map your own map dataset. B...

A web crawling framework implemented in Golang, it is simple to write and delivers powerful performance. It comes with a wide range of practical middl...

The Scripting Engine that Combines Speed, Safety, and Simplicity

Turn topics, links, and files into AI-generated research notebooks — summarize, explore, and ask anything.

Modern tests to detect automated browser behavior. Cover most important leaks from Puppeteer and Playwright.

A fast, modern and intelligent proxy rotator perfect for crawling and scraping public data.

Scrape data from Goodreads using Scrapy and Selenium :books:

Sasori is a dynamic web crawler powered by Puppeteer, designed for lightning-fast endpoint discovery.

Site que agrega filmes em cartaz em algumas das diversas salas de cinema de Porto Alegre.

Simple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)

A console application to scrape a valid watching links for any movie or series with exact season and episode number, you can also download a whole sea...

Distributed crawler, database and web frontend for public directories indexing

arxiv_miner is a toolkit for mining research papers on CS ArXiv.

📰 Build RSS 2.0 feeds from websites (and JSON APIs) automatically or with a few CSS selectors.

AI-native web scraper. Single binary with a bundled Claude Code skill. MIT-licensed alternative to Firecrawl.

A test suite of common scraper detection techniques. See how detectable your scraper stack is.

Nim library for querying HTML using CSS-selectors (like JavaScripts document.querySelector)

Use AWS Lambda functions as a proxy pool to scrape web pages.

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

AI tool for automating Upwork job applications using AI agents to find and qualify jobs, write personalized cover letters, and prepare for interviews...

Learn how to send POST requests with cURL.

Instagram Scraper. Scrape Instagram followers, following list, and post authors. Download CSV files with Instagram users from followers, following, ta...

Spiderbuf 是一个专注于 Python 爬虫练习的网站。提供丰富的爬虫教程、爬虫案例解析和爬虫练习题。Python爬虫开发强化练习，在矛与盾的攻防中不断提高技术水平，...

Use the MapReduce's Java interface to distributed crawle the data of Chinese universities and learn basic knowledge of hdfs.

HTTP client for Node.js with browser TLS fingerprint impersonation

JavaScript support and proxy rotation for Scrapy with ScrapingBee.

Scraping assistant tool. Editing and maintaining CSS/XPath selectors across webpages.

⬇️ A simple all-in-one CLI tool to download EVERYTHING from a URL (like youtube-dl/yt-dlp, forum-dl, gallery-dl, simpler ArchiveBox). 🎭 Uses headless...