pypi.org : unicodetokenizer

UnicodeTokenizer: tokenize all Unicode text

Registry - Source - Documentation - JSON
purl: pkg:pypi/unicodetokenizer
Keywords: UnicodeTokenizer , Tokenizer , Unicode , ZiTokenizer , ZiCutter , laohur , tokenizer , unicode
License: ICU,MIT-feh
Latest release: almost 2 years ago
First release: over 3 years ago
Downloads: 73 last month
Stars: 0 on GitHub
Forks: 0 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 9 days ago

• Readme
• Versions 25
• Dependent Packages 0
• Maintainers 1