tiny-tokenizer
🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.
Ecosystem
pypi.org
pypi.org
Latest Release
over 5 years ago
3.4.0
over 5 years ago
Versions
19
19
Downloads
171 last month
171 last month
Dependent Repos
16
16
Links
| Registry | pypi.org |
| Source | Repository |
| Docs | Documentation |
| JSON API | View JSON |
| CodeMeta | codemeta.json |
Package Details
| PURL |
pkg:pypi/tiny-tokenizer
spec |
| License | MIT |
| First Release | over 7 years ago |
| Last Synced | 9 days ago |
Repository
| Stars | 261 on GitHub |
| Forks | 26 on GitHub |
| Commits | 322 |
| Committers | 13 |
| Avg per Author | 24.769 |
| DDS | 0.457 |
Rankings on pypi.org
Overall
Top 8.0%
Dependent repos
Top 3.6%
Forks
Top 8.6%