Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org "sentencepiece" keyword
Top 2.4% on pypi.org
15 versions - Latest release: almost 4 years ago - 1 dependent package - 30 dependent repositories - 5.79 thousand downloads last month - 9,462 stars on GitHub - 1 maintainer
tf-sentencepiece 0.1.92
SentencePiece Encode/Decode ops for TensorFlow15 versions - Latest release: almost 4 years ago - 1 dependent package - 30 dependent repositories - 5.79 thousand downloads last month - 9,462 stars on GitHub - 1 maintainer
Top 8.0% on pypi.org
19 versions - Latest release: almost 4 years ago - 16 dependent repositories - 214 downloads last month - 214 stars on GitHub - 1 maintainer
tiny-tokenizer 3.4.0 💰
🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with...19 versions - Latest release: almost 4 years ago - 16 dependent repositories - 214 downloads last month - 214 stars on GitHub - 1 maintainer
Top 1.7% on pypi.org
28 versions - Latest release: 8 days ago - 3 dependent packages - 134 dependent repositories - 81.1 thousand downloads last month - 214 stars on GitHub - 1 maintainer
konoha 5.5.6 💰
Add your description here28 versions - Latest release: 8 days ago - 3 dependent packages - 134 dependent repositories - 81.1 thousand downloads last month - 214 stars on GitHub - 1 maintainer
Top 3.6% on pypi.org
66 versions - Latest release: about 1 year ago - 3 dependent packages - 103 dependent repositories - 23.1 thousand downloads last month - 259 stars on GitHub - 4 maintainers
pyonmttok 1.37.1
Fast and customizable text tokenization library with BPE and SentencePiece support66 versions - Latest release: about 1 year ago - 3 dependent packages - 103 dependent repositories - 23.1 thousand downloads last month - 259 stars on GitHub - 4 maintainers
nepalitokenizers 0.0.2
Pre-trained Tokenizers for the Nepali language with an interface to HuggingFace's tokenizers libr...2 versions - Latest release: 11 months ago - 74 downloads last month - 2 stars on GitHub - 1 maintainer
escape-unk 1.0.1
Escape unknown symbols in SentecePiece vocabularies5 versions - Latest release: over 1 year ago - 35 downloads last month - 0 stars on GitHub - 2 maintainers
Related Keywords
natural-language-processing
5
NLP
2
neural-machine-translation
2
tokenizer
2
janome
2
japanese
2
kytea
2
mecab
2
nlp
2
sudachi
2
text-processing
2
cpp
1
icu
1
machine-translation
1
python
1
nepali
1
wordpiece
1
huggingface
1
transformers
1
escaping
1
subword
1
bpe
1
unicode
1
opennmt
1
tokenization
1
word-segmentation
1
segmentation
1
learning
1
machine
1
tensorflow
1