0 Forks
2 Stars
2 Watchers

robots-agent

robots.txt agent with cache.

How to download and setup robots-agent

Open terminal and run command
git clone https://github.com/gajus/robots-agent.git
git clone is used to create a copy or clone of robots-agent repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with robots-agent https://github.com/gajus/robots-agent/archive/master.zip

Or simply clone robots-agent with SSH
[email protected]:gajus/robots-agent.git

If you have some problems with robots-agent

You may open issue on robots-agent support forum (system) here: https://github.com/gajus/robots-agent/issues