go_spider

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

crawler go

View on GitHub

1.8k Stars

470 Forks

1.8k Watchers

Go Language

mpl-2.0 License

Cost to Build

$214.3K

Market Value

$760.0K

How is this calculated?

Growth over time

22 data points · 2018-09-01 → 2025-02-01

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about go_spider

Question copied to clipboard

What is the hu17889/go_spider GitHub project? Description: "[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only. ". Written in Go. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone go_spider

Clone via HTTPS

git clone https://github.com/hu17889/go_spider.git

Clone via SSH

[email protected]:hu17889/go_spider.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the go_spider issue tracker:

Open GitHub Issues

Similar to go_spider

scrapy compose golang-examples moby go kubernetes awesome-go hugo gogs grafana syncthing go-ethereum etcd gin caddy traefik beego fzf harness frp cockroach hub terraform nsq minio cayley Qix echo iris kit