An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

crates.io "robots-txt" keyword

View the packages on the crates.io package registry that are tagged with the "robots-txt" keyword.

roboto 0.1.1
Parse and use Robots.txt files
2 versions - Latest release: over 1 year ago - 2.62 thousand downloads total - 0 stars on GitHub - 1 maintainer
robots_txt 0.7.0
A lightweight parser and generator for robots.txt.
10 versions - Latest release: over 5 years ago - 1 dependent package - 3 dependent repositories - 21.6 thousand downloads total - 12 stars on GitHub - 1 maintainer