tokenizers-node
Provides an implementation of today's most used tokenizers, with a focus on performances and versatility.
Ecosystem
npmjs.org
npmjs.org
Latest Release
about 2 years ago
0.14.2-dev0
about 2 years ago
Versions
3
3
Downloads
62 last month
62 last month
No dependent packages found.
Past Dependents
Include Past Dependents
Check this option to include packages that no longer depend on this package in their latest version but previously did.
Filter
Filter by Kind
Links
| Registry | npmjs.org |
| Source | Repository |
| Homepage | Homepage |
| JSON API | View JSON |
| CodeMeta | codemeta.json |
Package Details
| PURL |
pkg:npm/tokenizers-node
spec |
| License | Apache-2.0 |
| First Release | about 2 years ago |
| Last Synced | 15 days ago |
Repository
| Stars | 10,177 on GitHub |
| Forks | 980 on GitHub |
| Commits | 1729 |
| Committers | 112 |
| Avg per Author | 15.438 |
| DDS | 0.46 |