proxy.golang.org : github.com/u1and0/tokenize-split
`tokenize-split` is a command-line tool that tokenizes input text and splits it into multiple files, with each file containing a maximum number of tokens specified by the user.
Registry
-
Source
- Documentation
- JSON
purl: pkg:golang/github.com/u1and0/tokenize-split
License: MIT
Latest release: about 2 years ago
First release: about 2 years ago
Namespace: github.com/u1and0
Stars: 0 on GitHub
Forks: 0 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 10 days ago