Kabegame — An anime image crawler client with pluggable crawlers (from a GitHub plugin repo), wallpaper rotation, local folder sync album. Supports Wi...
雪球爬虫 高效爬取近期沪深A股股票评论并自动生成PDF版情感分析报告
A PasteBin scrapper that doesnt rely on the PasteBin scrape API
Slideshare to PDF downloader. Using Selenium and auto scroll-down to get the entire slides completely.
基于NodeJS的基金数据爬虫,爬取的数据存于github的@nullpointer/fund-data。
Golang爬虫 爬取汽车之家 二手车产品库
Some scrapy and web.py exmaples
a puppeteer walker 🕷 🕸
Powerful web scraping framework for Crystal
一个可以补全mp3,flac文件元数据的图形化界面。还可以下载歌词
Privacy Web Search Engine (not meta, own crawler)
fetchman is a simple crawler system/简单好用的爬虫框架
Scrape Learning (ctrip)
tumblr解析网站
NTU CEIBA 資料下載工具
基于 Venera App 的禁漫天堂 (JMComic) 漫画源插件,支持浏览、搜索、签到、节点延迟测试、图片分流测速等功能。
steam 特惠游戏榜单(自动刷新)
Automatically download all PDF files of searching results & their patent families found on Google Patents.
Just a crawler based on tg-cli for Telegram. Deprecated by now, please use telegram-export.
crawl QR-codes from search engines and look for bitcoin private keys
Midnight Sea: navigating in the waters of dark web markets
Extract data from websites in LLM ready JSON or CSV format. Crawl or Scrape entire website with Website Crawler
Wrapper for TikTok API
🔥 PHP library to warm up caches of URLs located in XML sitemaps
台股機器人,提供即時個股及大盤報價、走勢、新聞、盤後資料等 Telegram bot to query real-time TW stock quotes, charts, news, and other related informatio...
python requests + Django+ nodejs koa+ mysql to crawl eastmoney fund and stock data,for data analysis and visualiaztion .
Your preferred open source focused crawler for the deep web.
A bot that automatically sends emails to new ads posted in any desired xe.gr search url.
A crawler for automated functional testing of a web application
可视化爬虫(支持:哔哩哔哩 | 抖音 | 小红书 | 贴吧 | 微博 | 知乎 | 快手),异步、高效、直观地采集国内主流平台的媒体数据的前后端一体项目(Based on "Medi...
Instagram user's photos and videos downloader. Download all media files from any username. Working 2022!
News extraction and scraping. Article Parsing
a simplified directed customizable website crawler
Tumblr Download Tool with High Speed and Customization. 高性能&高定制化的Tumblr下载工具。
Some classic web crawler projects.一些经典的爬虫
Vietnamese text data crawler scripts for various sites (including Youtube, Facebook, 4rum, news, ...)
👾 CLI MetaSpy (Facebook, Instagram) scraper and crawler - instagram account, facebook accounts, pages and search
自动爬取所有PlayStationStore中的所有游戏信息,包括封面、描述、价格、评分等,生成网页并索引 # # # Automatically crawl all game infos in all playstation...
Golang module to detect bots and crawlers via the user agent
动漫之家漫画站电脑版原图爬虫
A command line tool based on the crypto-crawler library.
可配置的小说下载及电子书生成工具
Antidetect Headless Chrome Browser for Ruby Web Scraping and Automation
Free Facebook pages MetaData Scraping Library - Unlimited Calls
Open Crawler || Open Source Crawler
Implement scrapy with asyncio
Download HD images from pinterest by your favorite keywords
This is a Scrapy-based web-spider. It scrapes papers from TOP conferences and journals.
a quick start python mutil thread crawl
[码云](https://gitee.com/generals-space/site-mirror-py) 通用爬虫, 仿站工具, 整站下载