Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "wordpiece" keyword

nepalitokenizers 0.0.2
Pre-trained Tokenizers for the Nepali language with an interface to HuggingFace's tokenizers libr...
2 versions - Latest release: 11 months ago - 74 downloads last month - 2 stars on GitHub - 1 maintainer