pypi.org : astaligner
ASTAligner is designed to align tokens from source code snippets to Abstract Syntax Tree (AST) nodes using Tree-sitter for AST generation and various HuggingFace tokenizers for language tokenization. The library supports a wide range of programming languages and Fast tokenizers, enabling precise mapping between source code elements and their AST representations.
Registry
- Homepage
- Documentation
- JSON
purl: pkg:pypi/astaligner
Keywords:
c
, incremental
, parser
, parsing
, rust
, tree-sitter
, wasm
License: MIT
Latest release: 9 months ago
First release: 9 months ago
Downloads: 74 last month
Stars: 20,478 on GitHub
Forks: 1,788 on GitHub
Total Commits: 4439
Committers: 262
Average commits per author: 16.943
Development Distribution Score (DDS): 0.329
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Funding links: https://github.com/sponsors/tree-sitter, https://opencollective.com/tree-sitter, https://ko-fi.com/amaanq
Last synced: 5 days ago