scraping
Repositories (1766)
Async V2ray (VMESS) proxy rotation library for Python. Auto-update subscriptions, test connections, rotate user-agents, handle rate limits. Built on X...
Script to obtain information from a Steam profile, capable of extracting the name/nickname, avatar, real name, location, recent activity, level, and p...
The library provides convenient access to the Outscraper API from applications written in server-side JavaScript. Allows using Outscraper's services f...
Open-source privacy focused show downloader & tracker.
A 100% working Justdial scrapper, Just enter the url and it'll extract business info from it
This project collects Wikipedia articles from a search term entered by the user and formats the data into a .docx (Word Document) document with images...
Código de @columnistos y sus hermanas
This is a django app for getting the meaning of an English word from command line.
Magic utility that extract javascript global variables from a remote html page.
Get results from search engines.
The objective of this project is to monitor the trends in data science job opportunities. We achieve this through scraping of the jobserve website.
An application designed to scrap the web and retrieve information from movie websites. Built with Ruby.
simple web scraping: extract texts and links as CSV, and save images of multiple websites
A simple shell script written to scrape gym activity data from the PureGym website members' area.
This program scrapes Amazon to get book data (the ISBN, title, author, price, etc.) of the top 100 Best Selling books in EVERY category and every subc...
Simple Email Scraper
👥 The best directory of Yale personnel, with a clean API to match. Used by 70% of undergrads!
Web scrapers using Scrapy framework to collect prices from online supermarkets and other sources.
An incomplete bandcamp python toolset (mainly downloads your collection)
Take the GoogleMeet Attendance without much effort!
A web scraper written in Python to gather trade data for India across commodities and countries
Monitor Amazon Vine queues for new items and display them in a browser tab
Django Search Engine, Scrape links and text from different search engine as mentioned in Readme and Display it.
Small algorithm for getting Antoine's coefficient to calculate vapor pressure from NIST web book.
Campsite Reservation Cancellation Finder (Yellowstone National Park)
ScrapingAnt API client for JavaScript / Node.js.
CloudflareIuamSolver is the Java library for breaking through the Cloudflare's "I am Under Attack Mode"
Track BCHydro Outages via Git history
Tool for retrieving cheapest price for any product comparing across e-commerce platforms like Amazon, Flipkart, Snapdeal, Ebay
HTTP / HTTPS Proxy
超星学习通 收件箱、任务、章节、讨论、作业、考试、资料、错题集、学习记录 获取，以及资料批量下载（学生端）
Overview of game release dates, prices and news
Scrape and structure raw data from the Norwegian parliament's API.
A basic web script for copying contents
Web crawler/spider for node.js & nest.js server
Export the articles and reports from Google Scholar easily! (The spider structure is inspired by the Scrapy framework)
A full-stack e-commerce affiliate app focusing on reducing plastic consumption that uses Next.js and Prisma.
Universal Python script to scrape many typical websites
AI web scraping python library for efficient and reliable web scraping.
Dive into web scraping and build a Next.js 14 eCommerce price tracker within one project that teaches you data scraping, cron jobs, sending emails, de...
Google Extension - DOM Pick and Send API
Script do meu projeto de conclusão de curso no MBA em Data Science e Analytics pela USP/Esalq.
The research paper scrape bot is designed to help researchers and students find academic papers by scraping websites. The bot uses web scraping techni...
[ACL 2024] Evaluation of the Fundus News Scraper
Web scraping API for Finnish websites
Scrape Discord Channels without hitting the Rate Limits
A reverse-engineered Express.js proxy for Blackbox AI's chat API. Supports custom prompts, image generation, web search, and chat history with multipl...
From Reddit to Knowledge Graph: a Zettelkasten System from Saved Posts
A powerful tool that enables developers to extract comprehensive product data from major eCommerce platforms, including Amazon and Wayfair.
Dokusha is a versatile manga and webtoon reader crafted with React Native, drawing inspiration from the renowned Tachiyomi platform. Built with extens...