pypi.org "cpython-extension" keyword
View the packages on the pypi.org package registry that are tagged with the "cpython-extension" keyword.
rs-bpe 0.1.0
A ridiculously fast Python BPE (Byte Pair Encoder) implementation written in Rust1 version - Latest release: about 1 month ago - 1.91 thousand downloads last month - 1 stars on GitHub - 1 maintainer
Related Keywords
byte-pair-encoding
1
subword-tokenization
1
subword-units
1
tokenization
1
tokenizer
1
vocabulary
1
vocab
1
text-encoding
1
text-processing
1
string-encoding
1
rust
1
rust-extension
1
python-library
1
python-package
1
pypi
1
cross-platform
1
fast
1
performance
1
high-performance
1
efficient
1
optimized
1
speed
1
blazing-fast
1
rapid
1
accelerated
1
nlp
1
natural-language-processing
1
machine-learning
1
deep-learning
1
artificial-intelligence
1
ai
1
llm
1
large-language-models
1
transformers
1
generative-ai
1
text-generation
1
embeddings
1
data-science
1
research
1
linguistics
1
openai
1
tiktoken
1
tiktoken-alternative
1
tiktoken-compatible
1
huggingface
1
huggingface-tokenizers
1
tokenizers-library
1
developers
1
scientists
1
researchers
1
data-scientists
1
machine-learning-engineers
1
nlp-engineers
1
production-ready
1
stable
1
library
1
package
1
tool
1
sentencepiece
1
wordpiece
1
unigram
1
bpe-dropout
1
backtracking
1