Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
nuget.org : alumis.text.tokenization
Text tokenization based on Unicode grapheme clustering, and the XID_Start and XID_Continue binary properties.
Registry
- JSON
purl: pkg:nuget/alumis.text.tokenization
Keywords: text, tokenization, unicode
License:
Latest release: about 5 years ago
First release: about 5 years ago
Downloads: 5,853 total
Last synced: 7 days ago
Loading...
Readme
Loading...