Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

nuget.org "wordpiece-tokenization" keyword

View the packages on the nuget.org package registry that are tagged with the "wordpiece-tokenization" keyword.

fastberttokenizer 1.0.28
Fast and memory-efficient WordPiece tokenizer as it is used by BERT and others. Tokenizes text fo...
12 versions - Latest release: over 1 year ago - 2 dependent packages - 436 thousand downloads total - 49 stars on GitHub - 1 maintainer
Related Keywords
bert 1 tokenizer 1 wordpiece 1 llm 1 semantic-kernel 1 performance 1 ai 1 artificial-intelligence 1 ml 1 machine-learning 1 bert-embeddings 1 natural-language-processing 1 nlp 1 nlp-machine-learning 1 tokenization 1 tokens 1