Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

nuget.org : nick.robotsparser

https://github.com/nicholasbergesen/RobotsParser/blob/master/README.md

Registry - JSON
purl: pkg:nuget/nick.robotsparser
Keywords: robots, parse, web, crawling, robots.txt, scraping, spider, sitemap
License:
Latest release: over 1 year ago
First release: over 2 years ago
Downloads: 4,207 total
Last synced: 11 days ago

Readme