crates.io : bpe-openai
Prebuilt fast byte-pair encoders for OpenAI.
Registry
-
Source
- Documentation
- JSON
purl: pkg:cargo/bpe-openai
Keywords:
algorithm
, bpe
, encoding
, tokenizer
License: MIT
Latest release: 5 months ago
First release: 12 months ago
Downloads: 45,924 total
Stars: 81 on GitHub
Forks: 10 on GitHub
Total Commits: 124
Committers: 6
Average commits per author: 20.667
Development Distribution Score (DDS): 0.339
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Last synced: 2 days ago
Loading...
Readme
Loading...