Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

robots-parser

A specification compliant robots.txt parser with wildcard (*) matching support.

Ecosystem
npmjs.org
Latest Release
3.0.1
about 3 years ago
Versions
11
Downloads
7,952,042 last month
Dependent Packages
45
Dependent Repos
5,176
    Loading...
    Readme
    Loading...
    Links
    Registry npmjs.org
    Source Repository
    JSON API View JSON
    CodeMeta codemeta.json
    Package Details
    PURL pkg:npm/robots-parser
    spec
    License MIT
    First Release over 11 years ago
    Last Synced about 18 hours ago
    Keywords
    robots.txt parser user-agent scraper spider bot robots-exclusion-standard javascript nodejs rfc-9309 robots-parser robots-txt
    Repository
    Stars 150 on GitHub
    Forks 19 on GitHub
    Docker Dependents 71
    Docker Downloads 207,172,698
    Commits 79
    Committers 8
    Avg per Author 9.875
    DDS 0.127
    commits.ecosyste.ms
    repos.ecosyste.ms
    Rankings on npmjs.org
    Overall Top 1.9%
    Downloads Top 0.2%
    Dependent packages Top 0.7%
    Dependent repos Top 0.3%
    Forks Top 5.6%
    Docker downloads Top 0.1%