Top 6.4% downloads on crates.io
Top 1.6% dependent packages on crates.io
Top 3.9% dependent repos on crates.io
crates.io : tiktoken-rs
Library for encoding and decoding with the tiktoken library in Rust
Registry
-
Source
- Documentation
- JSON
purl: pkg:cargo/tiktoken-rs
Keywords:
ai
, bpe
, gpt
, openai
, rust
, tokenizer
License: MIT
Latest release: 2 months ago
First release: over 2 years ago
Dependent packages: 39
Dependent repositories: 73
Downloads: 1,540,593 total
Stars: 311 on GitHub
Forks: 54 on GitHub
Docker dependents: 1
Docker downloads: 317
Total Commits: 74
Committers: 5
Average commits per author: 14.8
Development Distribution Score (DDS): 0.189
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Last synced: about 1 month ago