Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

conda-forge.org "robots-txt" keyword

protego 0.2.1
A pure-Python robots.txt parser with support for modern conventions.
2 versions - Latest release: about 2 years ago - 4 dependent packages - 15 dependent repositories - 38 stars on GitHub
ultimate-sitemap-parser 0.5
Ultimate Website Sitemap Parser
1 version - Latest release: over 1 year ago - 126 stars on GitHub
Related Keywords
python 2 hacktoberfest 1 robots-parser 1 python-3 1 python3 1 sitemap 1 sitemap-xml 1 xml-sitemap 1 xml-sitemap-parser 1