Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
nuget.org : portedfastberttokenizer
Fast and memory-efficient WordPiece tokenizer as it is used by BERT and others. Tokenizes text for further processing using NLP/language models. This fork only supports .NET Standard 2.1
Registry
- Homepage
- JSON
purl: pkg:nuget/portedfastberttokenizer
Keywords: bert, tokenizer, wordpiece, llm, semantic-kernel, performance, ai, artificial-intelligence, ml, machine-learning
License: MIT
Latest release: 6 months ago
First release: 6 months ago
Stars: 0 on GitHub
Forks: 0 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 27 days ago