`tiny-tokenizer`

🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.

Ecosystem
pypi.org

Latest Release
3.4.0
over 5 years ago

Versions
19

Downloads
171 last month

Dependent Repos
16

No dependent packages found.

Check this option to include packages that no longer depend on this package in their latest version but previously did.

Keywords
janome japanese kytea mecab natural-language-processing nlp sentencepiece sudachi text-processing

commits.ecosyste.ms

repos.ecosyste.ms

Overall Top 8.0%

Dependent repos Top 3.6%

Forks Top 8.6%

ecosyste.ms