grab-site
ArchiveTeam
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
1k
Stars
113
Forks
1k
Watchers
Python
Language
other
License
Growth over time
7 data points · 2021-08-01 → 2023-07-01
Stars
Forks
Watchers
💬
How do you feel about this project?
Ask AI about grab-site
Question copied to clipboardWhat is the ArchiveTeam/grab-site GitHub project? Description: "The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
How to clone grab-site
Clone via HTTPS
git clone https://github.com/ArchiveTeam/grab-site.git
Clone via SSH
[email protected]:ArchiveTeam/grab-site.git
Download ZIP
Download master.zipFound an issue?
Report bugs or request features on the grab-site issue tracker:
Open GitHub Issues