Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
anaconda.org : tokenizers
Provides an implementation of today's most used tokenizers, with a focus on performance and versatility.
Registry
-
Source
- JSON
purl: pkg:conda/tokenizers
Keywords: bert, gpt, language-model, natural-language-processing, natural-language-understanding, nlp, transformers
License: Apache-2.0
Latest release: 2 months ago
First release: over 2 years ago
Dependent packages: 3
Dependent repositories: 35
Stars: 6,601 on GitHub
Forks: 560 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 1 day ago
transformers 4.37.2
Transformers provides thousands of pretrained models to perform tasks on different modalities suc...8 versions - Latest release: 2 months ago - 4 dependent packages - 101 dependent repositories - 86,717 stars on GitHub
spacy-model-fr_dep_news_trf 3.5.0
Components: transformer, morphologizer, parser, attribute_ruler, lemmatizer.1 version - Latest release: 11 months ago
anaconda 5.3.1
Anaconda is a Python distribution which includes over 400 Python packages for science, math, engi...25 versions - Latest release: over 5 years ago - 206 dependent repositories