go_spider

crawler go

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

How to download and setup go_spider

Open terminal and run command

git clone https://github.com/hu17889/go_spider.git

git clone is used to create a copy or clone of go_spider repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with go_spider https://github.com/hu17889/go_spider/archive/master.zip

Or simply clone go_spider with SSH

[email protected]:hu17889/go_spider.git

If you have some problems with go_spider

You may open issue on go_spider support forum (system) here: https://github.com/hu17889/go_spider/issues

Similar to go_spider repositories

Here you may see go_spider alternatives and analogs

scrapy compose golang-examples moby go kubernetes awesome-go hugo gogs grafana syncthing go-ethereum etcd gin caddy traefik beego fzf drone frp cockroach hub terraform nsq minio cayley Qix echo iris kit