Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

anaconda.org : sentencepiece

SentencePiece implements subword units (e.g., byte-pair-encoding (BPE) [Sennrich et al.]) and unigram language model [Kudo.]) with the extension of direct training from raw sentences. SentencePiece allows us to make a purely end-to-end system that does not depend on language-specific pre/postprocessing.

Registry - Source - Homepage - JSON
purl: pkg:conda/sentencepiece
Keywords: natural-language-processing, neural-machine-translation, word-segmentation
License: Apache-2.0
Latest release: 11 months ago
First release: over 2 years ago
Dependent packages: 2
Dependent repositories: 25
Stars: 6,851 on GitHub
Forks: 902 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 5 days ago

    Loading...
    Readme
    Loading...