pypi.org : robotsparse
A python package that enhances speed and simplicity of parsing robots files.
Registry
-
Source
- Homepage
- Documentation
- JSON
purl: pkg:pypi/robotsparse
Keywords:
parsing
, parser
, robots
, web-crawling
, crawlers
, crawling
, sitemaps
, sitemap
License: MIT
Latest release: 12 months ago
First release: 12 months ago
Downloads: 84 last month
Stars: 0 on GitHub
Forks: 0 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 3 days ago
Loading...
Readme
Loading...