scraping

Run Selenium with Python via Github Actions using Headless or Non-Headless browsers!

A collection of intel and usernames scraped from various cybercrime sources & forums. DarkForums, HackForums, Patched, Cracked, BreachForums, OGUser,...

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [i...

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library des...

Web Data Scraper - no-code internet scraping. Extract and export to CSV, Excel, JSON, Google Sheets, and Webhook.

An implementation of Google Deep Search 🕵️ with support for 1000+ references, local inference, chatting with your scraping session using RAPTOR, and...

Get structured JSON data from any page.

A simple Node.js code to get public information and media from every Instagram post or reel URL without API. Working 2025

Pick the most common user-agents on the Internet 👻

Scraping statistics, predicting NBA player performance with neural networks and boosting algorithms, and optimising lineups for Draft Kings with gene...

Python scraper for Language Pods such as Japanesepod101.com :japanese_ogre: :japan: :sushi: Compatible with Japanese, Chinese, French, German, Italian...

Code relating to scraping public police data.

:spider: Google client for SERPS

Scraping the TikTok discovery web API every 15 minutes using Github Actions to view changes

The Apify SDK for Python is the official library for creating Apify Actors in Python. It provides useful features like actor lifecycle management, loc...

Hear local historical markers as you travel on your road-trip. 100% Shared Compose UI, Kotlin native cross-platform codebase. Includes Cocoapods, Goog...

Scrape Algorithm Questions from leetcode and generate html and epub file

Model Context Protocol server that integrates AgentQL's data extraction capabilities.

Extract data or evaluate value from HTML/XML documents using XPath

Generate dispersable airdrops from Twitter threads.

API to get enormous amount of high resolution satellite images from satellites.pro quickly through multi-threading! create map your own map dataset. B...

A web crawling framework implemented in Golang, it is simple to write and delivers powerful performance. It comes with a wide range of practical middl...

The Scripting Engine that Combines Speed, Safety, and Simplicity

Turn topics, links, and files into AI-generated research notebooks — summarize, explore, and ask anything.

Modern tests to detect automated browser behavior. Cover most important leaks from Puppeteer and Playwright.

Sasori is a dynamic web crawler powered by Puppeteer, designed for lightning-fast endpoint discovery.

Scrape data from Goodreads using Scrapy and Selenium :books:

Stealth Chromium browser for large-scale web scraping.

Simple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)

Distributed crawler, database and web frontend for public directories indexing

A fast, modern and intelligent proxy rotator perfect for crawling and scraping public data.

A console application to scrape a valid watching links for any movie or series with exact season and episode number, you can also download a whole sea...

arxiv_miner is a toolkit for mining research papers on CS ArXiv.

📰 Build RSS 2.0 feeds from websites (and JSON APIs) automatically or with a few CSS selectors.

A test suite of common scraper detection techniques. See how detectable your scraper stack is.

Nim library for querying HTML using CSS-selectors (like JavaScripts document.querySelector)

Use AWS Lambda functions as a proxy pool to scrape web pages.

AI tool for automating Upwork job applications using AI agents to find and qualify jobs, write personalized cover letters, and prepare for interviews...

Instagram Scraper. Scrape Instagram followers, following list, and post authors. Download CSV files with Instagram users from followers, following, ta...

Learn how to send POST requests with cURL.

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.

Use the MapReduce's Java interface to distributed crawle the data of Chinese universities and learn basic knowledge of hdfs.

JavaScript support and proxy rotation for Scrapy with ScrapingBee.

Library with a set of tools for scraping information about Nintendo games and its prices across all regions (NA, EU and JP).

Python framework to scrape Pastebin pastes and analyze them

Machine learning for beginner(Data Science enthusiast)

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

Simple library for exploring/scraping the web or testing a website you’re developing