Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
anaconda.org : sentencepiece
SentencePiece implements subword units (e.g., byte-pair-encoding (BPE) [Sennrich et al.]) and unigram language model [Kudo.]) with the extension of direct training from raw sentences. SentencePiece allows us to make a purely end-to-end system that does not depend on language-specific pre/postprocessing.
Registry
-
Source
- Homepage
- JSON
purl: pkg:conda/sentencepiece
Keywords: natural-language-processing, neural-machine-translation, word-segmentation
License: Apache-2.0
Latest release: 11 months ago
First release: over 2 years ago
Dependent packages: 2
Dependent repositories: 25
Stars: 6,851 on GitHub
Forks: 902 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 5 days ago