pypi.org : pytokenizer

A streaming tokenizer.

Registry - Source - Documentation - JSON
purl: pkg:pypi/pytokenizer
Keywords: Python3 , Token , Tokenizer , Streaming , python3 , streaming-parser , streaming-tokenizer , tokenizer
License: Apache-2.0
Latest release: about 5 years ago
First release: almost 6 years ago
Dependent repositories: 1
Downloads: 42 last month
Stars: 0 on GitHub
Forks: 0 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 8 days ago

• Readme
• Versions 6
• Dependent Packages 0
• Maintainers 1