Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

anaconda.org : sentencepiece

SentencePiece implements subword units (e.g., byte-pair-encoding (BPE) [Sennrich et al.]) and unigram language model [Kudo.]) with the extension of direct training from raw sentences. SentencePiece allows us to make a purely end-to-end system that does not depend on language-specific pre/postprocessing.

Registry - Source - Homepage - JSON
purl: pkg:conda/sentencepiece
Keywords: natural-language-processing, neural-machine-translation, word-segmentation
License: Apache-2.0
Latest release: 12 months ago
First release: over 2 years ago
Dependent packages: 2
Dependent repositories: 25
Stars: 6,851 on GitHub
Forks: 902 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 16 days ago

optimum 1.12.0
🤗 Optimum is an extension of 🤗 Transformers, providing a set of performance optimization tools en...
2 versions - Latest release: 8 months ago - 989 stars on GitHub
spacy-model-fr_dep_news_trf 3.5.0
Components: transformer, morphologizer, parser, attribute_ruler, lemmatizer.
1 version - Latest release: 11 months ago