72m-domains-dataset

72m-domains-dataset

digitalcortex

Dataset with unique registered domains extracted from Common Crawl's columnar index (cc-index).

scraping
View on GitHub
21 Stars
3 Forks
21 Watchers
other License
100 SrcLog Score
Cost to Build
$500
Market Value
$890
How is this calculated?

Growth over time

3 data points  ·  2026-04-11 → 2026-04-25
Stars Forks Watchers
💬

How do you feel about this project?

Ask AI about 72m-domains-dataset

Question copied to clipboard

What is the digitalcortex/72m-domains-dataset GitHub project? Description: "Dataset with unique registered domains extracted from Common Crawl's columnar index (cc-index).". Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone 72m-domains-dataset

Clone via HTTPS

git clone https://github.com/digitalcortex/72m-domains-dataset.git

Clone via SSH

[email protected]:digitalcortex/72m-domains-dataset.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the 72m-domains-dataset issue tracker:

Open GitHub Issues

Similar to 72m-domains-dataset

scrapy requests-html webmagic colly headless-chrome-crawler Embed artoo instagram-scraper django-dynamic-scraper scrapy-cluster Lulu newcrawler panther facebook_data_analyzer ImageScraper scrapple parsel nickjs jsoup-annotations jekyll Sasila Musoq goose-parser arachnid lambdasoup crawler geeksforgeeks.pdf scrapy-zyte-smartproxy sqrape comic-dl