JewelCrawler

crawler

豆瓣电影爬虫——a crawler which is able to crawl movie detail and short comments, save them to database mysql, also include Sentiment analysis based on comments

How to download and setup JewelCrawler

Open terminal and run command

git clone https://github.com/DMinerJackie/JewelCrawler.git

git clone is used to create a copy or clone of JewelCrawler repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with JewelCrawler https://github.com/DMinerJackie/JewelCrawler/archive/master.zip

Or simply clone JewelCrawler with SSH

[email protected]:DMinerJackie/JewelCrawler.git

If you have some problems with JewelCrawler

You may open issue on JewelCrawler support forum (system) here: https://github.com/DMinerJackie/JewelCrawler/issues

Similar to JewelCrawler repositories

Here you may see JewelCrawler alternatives and analogs

scrapy Sasila Price-monitor webmagic colly headless-chrome-crawler Lulu newcrawler scrapple goose-parser arachnid gopa scrapy-zyte-smartproxy node-crawler arachni newspaper webster spidy N2H4 easy-scraping-tutorial antch pomp talospider podcastcrawler FileMasta lux scrapy-redis haipproxy DotnetSpider TumblThree