Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

tokenizer-lib

Tokenization utilities for building parsers in Rust

Ecosystem
crates.io
Latest Release
1.6.0
almost 2 years ago
Versions
15
Downloads
25,403 total
Dependent Packages
2
Dependent Repos
1
    Loading...
    Readme
    Loading...
    Links
    Registry crates.io
    Source Repository
    Docs Documentation
    JSON API View JSON
    CodeMeta codemeta.json
    Package Details
    PURL pkg:cargo/tokenizer-lib
    spec
    License MIT
    First Release about 5 years ago
    Last Synced 21 days ago
    Keywords
    tokenization utils parsing rust rust-crate tokenizer
    Repository
    Stars 2 on GitHub
    Forks 1 on GitHub
    repos.ecosyste.ms