x-crawl

async promise crawler

x-crawl is a flexible Node.js multifunctional crawler library. Flexible usage and numerous functions can help you quickly, safely, and stably crawl pages, interfaces, and files. ---------------- x-crawl 是一个灵活的 Node.js 多功能爬虫库。灵活的使用方式和众多的功能可以帮助您快速、安全、稳定地爬取页面、接口以及文件。

How to download and setup x-crawl

Open terminal and run command

git clone https://github.com/coder-hxl/x-crawl.git

git clone is used to create a copy or clone of x-crawl repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with x-crawl https://github.com/coder-hxl/x-crawl/archive/master.zip

Or simply clone x-crawl with SSH

[email protected]:coder-hxl/x-crawl.git

If you have some problems with x-crawl

You may open issue on x-crawl support forum (system) here: https://github.com/coder-hxl/x-crawl/issues

Similar to x-crawl repositories

Here you may see x-crawl alternatives and analogs

You-Dont-Know-JS axios ava scrapy swoole-src core-js curequests Sasila requests-threads saber asks Price-monitor ktor kotlinx.coroutines react-loadable ocl angular-async-loader require-vuejs couchbase-odm funfix webmagic colly headless-chrome-crawler Lulu newcrawler scrapple goose-parser arachnid gopa scrapy-zyte-smartproxy