Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org "robots.txt" keyword
django-env-robots
Control robots.txt files from environment variables and templates.5 versions - 491 downloads last month - 0 stars on GitHub - 2 maintainers
Top 4.3% on pypi.org
10 versions - Latest release: almost 8 years ago - 15 dependent repositories - 43 thousand downloads last month - 1 maintainer
robotexclusionrulesparser 1.7.1
A robots.txt parser alternative to Python's robotparser module10 versions - Latest release: almost 8 years ago - 15 dependent repositories - 43 thousand downloads last month - 1 maintainer
django-roberts 0.1.3
A simple Django app to provide access to a robots.txt file9 versions - Latest release: over 9 years ago - 2 dependent repositories - 10 downloads last month - 1 maintainer
robotsparser 0.0.12
Parse robots.txt files and find indexed urls11 versions - Latest release: over 1 year ago - 111 downloads last month - 0 stars on GitHub - 1 maintainer
Top 3.7% on pypi.org
10 versions - Latest release: 2 months ago - 6 dependent packages - 799 dependent repositories - 1.36 million downloads last month - 52 stars on GitHub - 4 maintainers
protego 0.3.1
Pure-Python robots.txt parser with support for modern conventions10 versions - Latest release: 2 months ago - 6 dependent packages - 799 dependent repositories - 1.36 million downloads last month - 52 stars on GitHub - 4 maintainers
historical-robots-txt-parser 0.1.2
Parses historical robots.txt files from Wayback Machine2 versions - Latest release: about 4 years ago - 1 dependent repositories - 14 downloads last month - 0 stars on GitHub - 1 maintainer
robotsparsetools 1.3.3
Parse robots.txt11 versions - Latest release: over 2 years ago - 1 dependent repositories - 62 downloads last month - 0 stars on GitHub - 1 maintainer