Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
crates.io : token
A simple string-tokenizer (and sentence splitter) Note: If you find that you would like to use the name for something more appropriate, please just send me a mail at jaln at itu dot dk
Registry
-
Source
- Documentation
- JSON
purl: pkg:cargo/token
Keywords: sentence, splitter, tokenizer, string
License: MIT
Latest release: over 9 years ago
First release: over 9 years ago
Dependent repositories: 1
Downloads: 2,005 total
Stars: 5 on GitHub
Forks: 2 on GitHub
Docker dependents: 29
Docker downloads: 23,282,355
See more repository details: repos.ecosyste.ms
Last synced: 17 days ago