java-spider

hemin1003

一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。

elasticsearch

View on GitHub

343 Stars

150 Forks

343 Watchers

Java Language

Cost to Build

$1.17M

Market Value

$3.93M

How is this calculated?

Growth over time

8 data points · 2021-07-01 → 2025-09-01

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about java-spider

Question copied to clipboard

What is the hemin1003/java-spider GitHub project? Description: "一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。". Written in Java. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone java-spider

Clone via HTTPS

git clone https://github.com/hemin1003/java-spider.git

Clone via SSH

[email protected]:hemin1003/java-spider.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the java-spider issue tracker:

Open GitHub Issues

Similar to java-spider

grafana elasticsearch FOSElasticaBundle crawler bookbrainz-site elastic4s elk-docker dev-setup zentral Opserver elasticsearch-HQ pipeline sentinl awesome-aws yii2-elasticsearch great-big-example-application gardening dejavu mirage kibana NewsBlur analysis-ik docker-elk elasticsearch-sql Linux-Tutorial searchkit elasticsearch-dump peek elastic vue-storefront