Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
anaconda.org : tokenizers
Provides an implementation of today's most used tokenizers, with a focus on performance and versatility.
Registry
-
Source
- JSON
purl: pkg:conda/tokenizers
Keywords: bert, gpt, language-model, natural-language-processing, natural-language-understanding, nlp, transformers
License: Apache-2.0
Latest release: 2 months ago
First release: over 2 years ago
Dependent packages: 3
Dependent repositories: 35
Stars: 6,601 on GitHub
Forks: 560 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 1 day ago