An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pub.dev "bpe" keyword

gpt_tokenizer 0.1.1
The implementation of BPE algorithm for sentence encode/decode
2 versions - Latest release: about 2 years ago - 1 dependent package - 1 dependent repositories - 10 stars on GitHub