webcrawler
ssharmapavitra
Crawler is a C++ & Node.js application that allows you to crawl web pages, save them locally, and extract hyperlinks from the page body. It provides a simple command-line interface where you can enter the starting URL and specify the maximum number of crawls. The crawler follows the hyperlinks recursively, saves the web pages in specified directo
Growth over time
3 data points · 2025-07-23 → 2026-04-19How do you feel about this project?
Ask AI about webcrawler
Question copied to clipboardWhat is the ssharmapavitra/webcrawler GitHub project? Description: "Crawler is a C++ & Node.js application that allows you to crawl web pages, save them locally, and extract hyperlinks from the page body. It provides a simple command-line interface where you can enter the starting URL and specify the maximum number of crawls. The crawler follows the hyperlinks recursively, saves the web pages in specified directo". Written in C++. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
How to clone webcrawler
Clone via HTTPS
Clone via SSH
Download ZIP
Download master.zipFound an issue?
Report bugs or request features on the webcrawler issue tracker:
Open GitHub Issues