Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

anaconda.org : tokenizers

Provides an implementation of today's most used tokenizers, with a focus on performance and versatility.

Registry - Source - JSON
purl: pkg:conda/tokenizers
Keywords: bert, gpt, language-model, natural-language-processing, natural-language-understanding, nlp, transformers
License: Apache-2.0
Latest release: about 1 month ago
First release: about 2 years ago
Dependent packages: 3
Dependent repositories: 35
Stars: 6,601 on GitHub
Forks: 560 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 3 days ago

    Loading...
    Readme
    Loading...