scraping

Automatically download all your favorite anime from AnimePahe

Python-based web scraping and data analysis tool designed to collect vehicle listings from the Autoscout24 website.

Get a Discord alert when a new item is posted on Yahoo Auction or Mercari

Allows to bypass Cloudflare checks

Scraping Code4rena contest audits reports for stats, fun (and profit ?)

Download images from reddit

🤖 A Discord bot that allows you to access solutions to homework problems from Chegg.

AgentQL's integrations with workflow automation tools and AI agent frameworks let you extract structured data from web pages using queries or natural...

DeepState Map | Occupied | GeoJSON Multipolygon | Daily update

Command line program to download documents from web portals

Price Tracker app for Android and iOS. Built with Flutter

Quick and dirty date parsing Python library to parse HTML dates really fast

A Python framework to build polite, but tenacious crawlers / scrapers with a MariaDB backend

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

Scrape and parse HTML tables with the Puppeteer table parser.

[🚧 WIP] Cross-platform microservice to scrape the IMDb website.

Google images scrapper in full resolution with multi threading speed.

eCommerce Scraping API code examples for Python, PHP and Node.js

Scrape structured data from HTML documents automatically

Code examples and general information

Tiny little ruby on rails website that crawls though your public github repos to find out what your favourite languages are.

A Telegram bot combined with python to serve some basic functions like weather, music charts, cricket score and much more.

JustDial Scraper to scrap all the requested data which includes their name, address, email address and phone number.

API for scrapping common 🇵🇱 meme sites

A small CLI app to scrap high-quality movie snapshots from various websites.

A simple python CardMarket price scraper.

Scrapes: [HTTP, HTTPS, SOCKS4, and SOCKS5] || "Bypasses" and scrapes paid proxies

Scraping of 5 types of fuel :fuelpump: from 8 different fuelcompanies in Denmark :denmark:.

A tutorial for scraping Instagram profile information and posts using Scraping Fish API: https://scrapingfish.com

Downloads all refcardz from https://dzone.com/refcardz

A simple tool-kit written in python for sourcing and displaying macroeconomic and financial data.

Python library to scrape social media data via the EnsembleData API.

Dataset with unique registered domains extracted from Common Crawl's columnar index (cc-index).

Official Python SDK for the Supadata API.

A Python script that auto downloads all reels sent to your Instagram DM

Transparent man-in-the-middle (MitM) proxy for the Chrome DevTools Protocol (CDP). Intercept, modify, inject, and filter messages and events between a...

This Python script is designed to scrape articles from The Guardian's technology section using their API. It fetches article data, extracts the titles...

ProxyCrawl PHP library for scraping and crawling websites

A python library for scraping videos from JW Player

Google's Bard ChatBot Unofficial NodeJS API

A 100% working Justdial scrapper, Just enter the url and it'll extract business info from it

Toolkit to assist in stock checking and checkout automation of various retail sites.

node.js library for scraping GitHub trending repositories.

Automatically post Github trends on Facebook page

Easily crawl news portals or blog sites using Storm Crawler.

search engine for python (Query and scrape search engines)

Collection of scripts to help with web based ctfs.

Projet pour générer la page http://clementgrimal.fr/darwin/

Xplore is a scraper for Twitter/X without using API in Rust.

Automatically fetch and update proxy lists from multiple sources every 6 hours using GitHub Actions