rust_tokenizers
High performance tokenizers for Rust
Ecosystem
crates.io
crates.io
Latest Release
over 2 years ago
8.1.1
over 2 years ago
Versions
34
34
Downloads
359,081 total
359,081 total
Dependent Packages
11
11
Dependent Repos
225
225
Links
| Registry | crates.io |
| Source | Repository |
| Docs | Documentation |
| JSON API | View JSON |
| CodeMeta | codemeta.json |
Package Details
| PURL |
pkg:cargo/rust_tokenizers
spec |
| License | Apache-2.0 |
| First Release | about 6 years ago |
| Last Synced | 5 days ago |
Repository
| Stars | 324 on GitHub |
| Forks | 31 on GitHub |
| Docker Dependents | 32 |
| Docker Downloads | 23,282,815 |
| Commits | 368 |
| Committers | 8 |
| Avg per Author | 46.0 |
| DDS | 0.092 |
Rankings on crates.io
Overall
Top 6.3%
Downloads
Top 5.4%
Dependent packages
Top 4.7%
Dependent repos
Top 2.7%
Docker downloads
Top 3.3%