pypi.org : code-tokenize
Fast program tokenization and structural analysis in Python
Registry
-
Source
- Documentation
- JSON
- codemeta.json
purl: pkg:pypi/code-tokenize
Keywords:
code
, tokenization
, tokenize
, program
, language processing
, ast
, code-analysis
, language
, parser
License: MIT
Latest release: about 1 year ago
First release: over 4 years ago
Dependent repositories: 2
Downloads: 2,422 last month
Stars: 59 on GitHub
Forks: 10 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: about 1 month ago