robots-txt-parser

bopoda

PHP class for parse all directives from robots.txt files according to specifications

yandex

View on GitHub Website

47 Stars

16 Forks

47 Watchers

DIGITAL Command Language Language

mit License

100 SrcLog Score

Cost to Build

$11.8K

Market Value

$25.7K

How is this calculated?

Growth over time

8 data points · 2021-08-01 → 2026-04-01

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about robots-txt-parser

Question copied to clipboard

What is the bopoda/robots-txt-parser GitHub project? Description: "PHP class for parse all directives from robots.txt files according to specifications". Written in DIGITAL Command Language. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone robots-txt-parser

Clone via HTTPS

git clone https://github.com/bopoda/robots-txt-parser.git

Clone via SSH

[email protected]:bopoda/robots-txt-parser.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the robots-txt-parser issue tracker:

Open GitHub Issues

Similar to robots-txt-parser

gemini yandex-php-library lexicon yaspeller clickhouse-driver CloudCross react-yandex-maps pymystem3 vue-yandex-map DynamicTranslator ydcmd Robots.txt-Parser-Class yandex-map-react clickhouse-sqlalchemy voicer yandex nemiro.oauth ClickHouse-Net js MLatImperial2017 YmlGenerator yandex-weather-cli search-by-image yandex-kassa metrika-js-errors yandex-checkout-node 1 oversetter yandex-translate-api ekstertera