Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. Docs 文档 :point_right:
Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO :point_right:
A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
How to set up Scrapyd cluster on Heroku