crates.io : bytepiece_rs
The Bytepiece Tokenizer Implemented in Rust
Registry
-
Source
- Documentation
- JSON
purl: pkg:cargo/bytepiece_rs
Keywords:
bytepiece
, nlp
, tokenizer
, language-model
License: MIT
Latest release: over 1 year ago
First release: almost 2 years ago
Dependent packages: 1
Downloads: 10,034 total
Stars: 14 on GitHub
Forks: 0 on GitHub
Total Commits: 34
Committers: 1
Average commits per author: 34.0
Development Distribution Score (DDS): 0.0
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Last synced: 7 days ago