crates.io : robotparser

robots.txt parser for Rust

Registry - Source - Documentation - JSON
purl: pkg:cargo/robotparser
Keywords: robots , robot , spider , crawler , parser , http , robots-parser , rust
License: MIT
Latest release: over 3 years ago
First release: about 10 years ago
Dependent packages: 3
Dependent repositories: 2
Downloads: 35,593 total
Stars: 18 on GitHub
Forks: 9 on GitHub
See more repository details: repos.ecosyste.ms
Funding links: https://github.com/sponsors/messense
Last synced: 9 days ago

• Readme
• Versions 19
• Dependent Packages 3
• Maintainers 1
• Related Packages 1