crates.io "word-segmentation" keyword
View the packages on the crates.io package registry that are tagged with the "word-segmentation" keyword.
nlpo3 1.4.0
Thai natural language processing library, with Python and Node bindings8 versions - Latest release: 9 months ago - 1 dependent package - 1 dependent repositories - 17.6 thousand downloads total - 35 stars on GitHub - 2 maintainers
nlpo3-cli 0.2.0
Command line interface for nlpO3, a Thai natural language processing library3 versions - Latest release: almost 4 years ago - 3.57 thousand downloads total - 35 stars on GitHub - 2 maintainers
kitoken 0.10.1 💰
Fast and versatile tokenizer for language models, supporting BPE, Unigram and WordPiece tokenization2 versions - Latest release: 7 months ago - 6.03 thousand downloads total - 26 stars on GitHub - 1 maintainer