tokenizers-node
Provides an implementation of today's most used tokenizers, with a focus on performances and versatility.
Ecosystem
npmjs.org
npmjs.org
Latest Release
about 2 years ago
0.14.2-dev0
about 2 years ago
Versions
3
3
Downloads
62 last month
62 last month
Links
| Registry | npmjs.org |
| Source | Repository |
| Homepage | Homepage |
| JSON API | View JSON |
| CodeMeta | codemeta.json |
Package Details
| PURL |
pkg:npm/tokenizers-node
spec |
| License | Apache-2.0 |
| First Release | about 2 years ago |
| Last Synced | 18 days ago |
Repository
| Stars | 10,177 on GitHub |
| Forks | 980 on GitHub |
| Commits | 1729 |
| Committers | 112 |
| Avg per Author | 15.438 |
| DDS | 0.46 |