pypi.org : code-tokenize
Fast program tokenization and structural analysis in Python
Registry
-
Source
- Documentation
- JSON
purl: pkg:pypi/code-tokenize
Keywords:
code
, tokenization
, tokenize
, program
, language processing
, ast
, code-analysis
, language
, parser
License: MIT
Latest release: 3 months ago
First release: over 3 years ago
Dependent repositories: 2
Downloads: 6,324 last month
Stars: 53 on GitHub
Forks: 9 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: about 1 month ago