Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
crates.io "wordpiece" keyword
Top 2.5% on crates.io
25 versions - Latest release: about 2 months ago - 60 dependent packages - 281 dependent repositories - 798 thousand downloads total - 8,543 stars on GitHub - 3 maintainers
tokenizers 0.19.1
Provides an implementation of today's most used tokenizers, with a focus on performances and vers...25 versions - Latest release: about 2 months ago - 60 dependent packages - 281 dependent repositories - 798 thousand downloads total - 8,543 stars on GitHub - 3 maintainers
wordpieces 0.6.1
Split tokens into word pieces10 versions - Latest release: over 1 year ago - 3 dependent packages - 3 dependent repositories - 11.2 thousand downloads total - 5 stars on GitHub - 1 maintainer