Top 5.8% on proxy.golang.org
proxy.golang.org : github.com/shadowy-pycoder/tinybpe
Tiny implementation of the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. Ispired by karpathy/minbpe
Registry
-
Source
- Documentation
- JSON
purl: pkg:golang/github.com/shadowy-pycoder/tinybpe
License: MIT
Latest release: about 1 month ago
First release: about 1 month ago
Namespace: github.com/shadowy-pycoder
Stars: 0 on GitHub
Forks: 0 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 29 days ago
Loading...
Readme
Loading...