Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

rust_tokenizers

High performance tokenizers for Rust

Ecosystem
crates.io
Latest Release
8.1.1
over 2 years ago
Versions
34
Downloads
359,081 total
Dependent Packages
11
Dependent Repos
225
    Loading...
    Readme
    Loading...
    Links
    Registry crates.io
    Source Repository
    Docs Documentation
    JSON API View JSON
    CodeMeta codemeta.json
    Package Details
    PURL pkg:cargo/rust_tokenizers
    spec
    License Apache-2.0
    First Release about 6 years ago
    Last Synced 4 days ago
    Keywords
    nlp tokenizer machine-learning deep-learning rust-lang transformer
    Repository
    Stars 324 on GitHub
    Forks 31 on GitHub
    Docker Dependents 32
    Docker Downloads 23,282,815
    Commits 368
    Committers 8
    Avg per Author 46.0
    DDS 0.092
    commits.ecosyste.ms
    repos.ecosyste.ms
    Rankings on crates.io
    Overall Top 6.3%
    Downloads Top 5.4%
    Dependent packages Top 4.7%
    Dependent repos Top 2.7%
    Docker downloads Top 3.3%