proxy.golang.org : github.com/eliben/go-sentencepiece
Go implementation of the SentencePiece tokenizer
Registry
-
Source
- Documentation
- JSON
purl: pkg:golang/github.com/eliben/go-sentencepiece
Keywords:
encoding
, go
, golang
, language-model
, llm
, sentencepiece
, tokenization
License: Apache-2.0
Latest release: about 1 year ago
First release: about 1 year ago
Namespace: github.com/eliben
Stars: 35 on GitHub
Forks: 6 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 3 days ago