Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "byte-level" keyword

View the packages on the pypi.org package registry that are tagged with the "byte-level" keyword.

blt-tokenizer 0.2.2
High-performance byte-level tokenizer with BPE support
3 versions - Latest release: 2 months ago - 54 downloads last month - 0 stars on GitHub - 1 maintainer
precious-nlp 0.1.1
A tokenizer-free NLP library with T-FREE, CANINE, and byte-level approaches
2 versions - Latest release: 5 days ago - 0 stars on GitHub - 1 maintainer
Related Keywords
nlp 2 tokenizer 1 bpe 1 performance 1 tokenization 1 transformers 1 tokenizer-free 1 canine 1 tfree 1 natural-language-processing 1 deep-learning 1 pytorch 1