Top 1.5% downloads on pypi.org
Top 1.2% dependent packages on pypi.org
Top 1.0% dependent repos on pypi.org
Top 4.9% forks on pypi.org
Top 2.2% docker downloads on pypi.org
pypi.org : youtokentome
Unsupervised text tokenizer focused on computational efficiency
Registry
-
Source
- Documentation
- JSON
purl: pkg:pypi/youtokentome
Keywords:
bpe
, natural-language-processing
, nlp
, tokenization
, word-segmentation
License: MIT
Latest release: about 5 years ago
First release: almost 6 years ago
Dependent packages: 8
Dependent repositories: 228
Downloads: 59,699 last month
Stars: 966 on GitHub
Forks: 103 on GitHub
Docker dependents: 13
Docker downloads: 876
Total Commits: 58
Committers: 7
Average commits per author: 8.286
Development Distribution Score (DDS): 0.655
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Last synced: 16 days ago