scraping
Repositories (1766)
Flutter plugin to listen for and interact with all incoming notifications for Android. 一个监听手机通知的插件。
UpworkScraper allows you to scrape your best matches job postings from Upwork.
A simple CLI tool to browse GitHub's trending repositories from your terminal.
This project is an open-source API for retrieving multimedia content such as anime, movies and series, news, and manga in both Spanish and English.
🤖 A Versatile Telegram Bot
Repository for the Mastering Web Scraping in Python: Scaling to Distributed Crawling blogpost with the final code.
Overwatch API library for player details and career stats
⛏ A versatile Web scraper for Node.js
Search your favorite PS4 games from Playstation Store using the Command Line
Download images from Google Image Search
Node.js and PHP files to automatically downloading pictures from instagram by https://orsi.me/sniffagram
Official JavaScript/TypeScript library for interacting with Kameleo Client
PubMed scraper for async search on a list of keywords and concurrent extraction of all found URLs, returning a DataFrame/CSV containing all article da...
Unofficial Python client for Twitter
Spin up Tor containers and then proxy HTTP requests via these Tor instances
Extract structured data from any unstructured web page
xDSL Prometheus Exporter
A python package to generate random request fields for a http header.
Learn about how to rotate proxies by using Python.
A headless pure-python browser for the web
Tutorial for web scraping / crawling with Node.js.
With Selenium headless browsing and CAPTCHA solving
Fast TikTok NO Watermark Video Downloader (username or url)
ScrapingAnt API client for Python.
PHP Laravel Library for Scrapingbee Web Scraping API. AI querying supported. Also support Google, Walmart, Amazon, YouTube scraping
看理想 Python 客户端 / 下载器，下载看理想的音频和文稿
An admin UI project for a configurable web crawler platform
MITM HTTP(S) proxy with integrated load-balancing, rate-limiting and error handling. Built for automated web scraping.
A POSIX shell script to parse HTML
A Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)
Permaculture design app built on scraped plant databases. Drag-n-drop GUI with detailed design plan generator.
This repository is deprecated
a tool for extracting, searching, and saving JavaScript files (with optional headless browser)
Chew is a Go library for processing various content types into markdown/plaintext.
API Python para consulta na base de dados oficial do e-MEC
Tool for conveniently downloading audios from r/gonewildaudio and similar subreddits
Unsupervised clustering of movie posters with features extracted from Convolutional Neural Network
Collection of some simple python scripts to create https://myanimelist.net/ anime and user data set.
Generate JSON representations of HTML tables
Introduction to web scraping
Ethical Facebook and Gmail bruteforce... Bonus, proxy rotation for every attack based on user preference setting and also a web scrapping tool
🔎 um bot de Web Scraping para mostrar vagas do LinkedIn
🦩 A NextJS data parser, to scrape peacefully
DOM Based Content Extraction via Text Density
Unofficial NHentai mobile app with flutter and bloc
The most advanced raiplay.it downloader
Zyte API integration for Scrapy
Hyper Solutions SDK for Playwright - Bypass Akamai Bot Manager, Incapsula, Datadome and Kasada.
Web scraping API for building AI applications.
This script automates the installation of 50 OSINT tools for reconnaissance and information gathering.