packagist.org : diggin/diggin-robotrules

parser/handler for Robots Exclusion Protocol (robots.txt and more)

Registry - Source - JSON
purl: pkg:composer/diggin/diggin-robotrules
Keywords: spider , crawler , robots.txt , robots , robotstxt
License: BSD-3-Clause
Latest release: over 9 years ago
First release: about 13 years ago
Namespace: diggin
Dependent repositories: 5
Downloads: 187 total
Stars: 7 on GitHub
Forks: 2 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 16 days ago

• Readme
• Versions 5
• Dependent Packages 0
• Maintainers 1