pypi.org : faster-tokenizers
PaddleNLP Faster Tokenizer Library written in C++
Registry
-
Source
- Homepage
- Documentation
- JSON
purl: pkg:pypi/faster-tokenizers
Keywords:
bert
, compression
, distributed-training
, document-intelligence
, embedding
, ernie
, information-extraction
, llama
, llm
, neural-search
, nlp
, paddlenlp
, pretrained-models
, question-answering
, search-engine
, semantic-analysis
, sentiment-analysis
, transformers
, uie
License: Apache-2.0
Latest release: almost 3 years ago
First release: almost 3 years ago
Dependent repositories: 1
Downloads: 175 last month
Stars: 11,927 on GitHub
Forks: 2,905 on GitHub
Total Commits: 4784
Committers: 326
Average commits per author: 14.675
Development Distribution Score (DDS): 0.941
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Last synced: about 7 hours ago