Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

nuget.org "wordpiece" keyword

fastberttokenizer 1.0.28
Fast and memory-efficient WordPiece tokenizer as it is used by BERT and others. Tokenizes text fo...
10 versions - Latest release: 23 days ago - 2 dependent packages - 20 thousand downloads total - 22 stars on GitHub - 1 maintainer
vforteli.wordpiecetokenizer 0.1.0
Wordpiece tokenizer for using eg onnx models with ML.Net
1 version - Latest release: 24 days ago - 0 downloads total - 1 stars on GitHub - 1 maintainer
portedfastberttokenizer 0.4.6-beta
Fast and memory-efficient WordPiece tokenizer as it is used by BERT and others. Tokenizes text fo...
1 version - Latest release: 6 months ago - 0 stars on GitHub
Related Keywords
bert 3 tokenizer 3 llm 3 semantic-kernel 2 performance 2 ai 2 artificial-intelligence 2 ml 2 machine-learning 2 bert-embeddings 1 natural-language-processing 1 nlp 1 nlp-machine-learning 1 tokenization 1 tokens 1 wordpiece-tokenization 1 dotnet 1 .net 1 c# 1 ml.net 1