Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

nuget.org "wordpiece" keyword

View the packages on the nuget.org package registry that are tagged with the "wordpiece" keyword.

fastberttokenizer 1.0.28
Fast and memory-efficient WordPiece tokenizer as it is used by BERT and others. Tokenizes text fo...
12 versions - Latest release: over 1 year ago - 2 dependent packages - 470 thousand downloads total - 50 stars on GitHub - 1 maintainer
sentencepiecetokenizer 0.1.4
SentencePieceTokenizer is a wrapper around the google SentencePiece tokenizer. Used to tokenize t...
5 versions - Latest release: about 2 months ago - 1.24 thousand downloads total - 1 stars on GitHub - 1 maintainer
portedfastberttokenizer 0.4.6-beta
Fast and memory-efficient WordPiece tokenizer as it is used by BERT and others. Tokenizes text fo...
1 version - Latest release: almost 2 years ago - 1 stars on GitHub
vforteli.wordpiecetokenizer 0.1.1
Wordpiece tokenizer for using eg onnx models with ML.Net
2 versions - Latest release: 10 months ago - 318 downloads total - 1 stars on GitHub - 1 maintainer
Related Keywords
tokenizer 4 bert 3 llm 3 ai 3 semantic-kernel 2 performance 2 artificial-intelligence 2 ml 2 machine-learning 2 mlnet 1 ml.net 1 c# 1 .net 1 dotnet 1 sentencepiece 1 wordpiece-tokenization 1 tokens 1 tokenization 1 nlp-machine-learning 1 nlp 1 natural-language-processing 1 bert-embeddings 1