Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "subword" keyword

View the packages on the pypi.org package registry that are tagged with the "subword" keyword.

kolm 1.1.4
Korean LM toolkit for building ASR system
2 versions - Latest release: over 8 years ago - 2 dependent repositories - 19 downloads last month - 62 stars on GitHub - 1 maintainer
Top 3.6% on pypi.org
pyonmttok 1.37.1
Fast and customizable text tokenization library with BPE and SentencePiece support
66 versions - Latest release: over 2 years ago - 3 dependent packages - 103 dependent repositories - 22.8 thousand downloads last month - 310 stars on GitHub - 4 maintainers
tokenization-scorer 1.1.8
Package for evaluating text tokenizations.
12 versions - Latest release: 8 months ago - 82 downloads last month - 44 stars on GitHub - 1 maintainer
Related Keywords
tokenization 2 bpe 2 segmentation 1 natural language processing 1 evaluation 1 tokenizer 1 python 1 natural-language-processing 1 machine-translation 1 icu 1 cpp 1 sentencepiece 1 unicode 1 opennmt 1 pseudomorpheme 1 lm 1 korean 1 asr 1 Toolkit 1 Modeling 1 Language 1 Korean 1