proxy.golang.org : github.com/samclarke/robotstxt

Package robotstxt parses robots.txt files Aims to follow the Google robots.txt specification, see: https://developers.google.com/search/reference/robots_txt for more information.

Registry - Source - Documentation - JSON - codemeta.json
purl: pkg:golang/github.com/samclarke/robotstxt
Keywords: golang , robots-exclusion-standard , robots-parser , robots-txt , robotstxt
License: MIT
Latest release: almost 8 years ago
First release: almost 8 years ago
Namespace: github.com/samclarke
Dependent packages: 1
Dependent repositories: 1
Stars: 16 on GitHub
Forks: 7 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: about 1 month ago

• Readme
• Versions 1
• Dependent Packages 1
• Maintainers 0