Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
crates.io : pretok
A string pre-tokenizer for C-like syntaxes.
Registry
-
Source
- Documentation
- JSON
purl: pkg:cargo/pretok
Keywords: text, tokenizer, lexer, lexical-analysis, text-processing, tokenization
License: MIT
Latest release: over 3 years ago
First release: over 3 years ago
Dependent repositories: 1
Downloads: 506 total
Stars: 0 on GitHub
Forks: 0 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 4 days ago
Loading...
Readme
Loading...