@turingscript/tokenizers
Provides an implementation of today's most used tokenizers, with a focus on performances and versatility.
Ecosystem
npmjs.org
npmjs.org
Latest Release
about 2 years ago
0.15.2-alpha.4
about 2 years ago
Versions
1
1
Downloads
29 last month
29 last month
aaronclong
4 packages149 downloads
Links
| Registry | npmjs.org |
| Source | Repository |
| Homepage | Homepage |
| JSON API | View JSON |
| CodeMeta | codemeta.json |
Package Details
| PURL |
pkg:npm/%40turingscript/tokenizers
spec |
| License | Apache-2.0 |
| Namespace | turingscript |
| First Release | about 2 years ago |
| Last Synced | 29 days ago |
Repository
| Stars | 2 on GitHub |
| Forks | 0 on GitHub |