Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

Top 8.4% downloads on cran.r-project.org

cran.r-project.org : spiderbar

Parse and Test Robots Exclusion Protocol Files and Rules

Registry - Source - Documentation - JSON
purl: pkg:cran/spiderbar
Keywords: r, r-cyber, robots-exclusion-protocol, robots-txt, rstats
License: MIT
Latest release: over 1 year ago
First release: over 6 years ago
Dependent packages: 1
Downloads: 2,507 last month
Stars: 10 on GitHub
Forks: 1 on GitHub
Docker dependents: 7
Docker downloads: 131,478
See more repository details: repos.ecosyste.ms
Funding links: https://github.com/sponsors/hrbrmstr
Last synced: 12 days ago

Top 6.0% on cran.r-project.org

robotstxt 0.7.13

A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker
11 versions - Latest release: over 3 years ago - 5 dependent packages - 17 dependent repositories - 2.61 thousand downloads last month - 69 stars on GitHub - 1 maintainer