An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

nuget.org "tokenization" keyword

View the packages on the nuget.org package registry that are tagged with the "tokenization" keyword.

blism 1.3.2
A simple syntax highlighter library for Blazor.
10 versions - Latest release: 4 months ago - 1.85 thousand downloads total - 2 stars on GitHub - 1 maintainer
fastberttokenizer 1.0.28
Fast and memory-efficient WordPiece tokenizer as it is used by BERT and others. Tokenizes text fo...
12 versions - Latest release: about 1 year ago - 2 dependent packages - 436 thousand downloads total - 49 stars on GitHub - 1 maintainer
lexepars.testfixtures 1.3.0
Package Description
3 versions - Latest release: over 3 years ago - 71.3 thousand downloads total - 11 stars on GitHub - 1 maintainer
blism.language.dart 1.3.2
A simple syntax highlighter library for Blazor.
6 versions - Latest release: 4 months ago - 720 downloads total - 2 stars on GitHub - 1 maintainer
stanford.nlp.segmenter 4.2.0 💰
Tokenization of raw text is a standard pre-processing step for many NLP tasks. For English, token...
16 versions - Latest release: over 4 years ago - 26.6 thousand downloads total - 607 stars on GitHub - 1 maintainer
Top 9.1% on nuget.org
cybersource.flex.server 0.2.2
SDK for server-side integration with CyberSource Flex API
3 versions - Latest release: over 6 years ago - 1 dependent repositories - 39.6 thousand downloads total - 20 stars on GitHub - 1 maintainer
mcbits.tokenization 2.0.0
Extract tokens from a string of text for use with NLP tools or statistical analysis.
5 versions - Latest release: over 6 years ago - 1 dependent package - 6.94 thousand downloads total - 1 maintainer
blism.language.csharp 1.3.2
A simple syntax highlighter library for Blazor.
6 versions - Latest release: 4 months ago - 723 downloads total - 2 stars on GitHub - 1 maintainer
rochas.extensions 1.0.7
A useful set of extensions for .NET native types
7 versions - Latest release: 5 months ago - 1 dependent package - 1.33 thousand downloads total - 0 stars on GitHub - 1 maintainer
alumis.text.tokenization 1.0.9
Text tokenization based on Unicode grapheme clustering, and the XID_Start and XID_Continue binary...
10 versions - Latest release: over 6 years ago - 7.03 thousand downloads total - 0 stars on GitHub - 1 maintainer
metaparser 1.0.7
Package Description
14 versions - Latest release: over 2 years ago - 4.86 thousand downloads total - 0 stars on GitHub - 1 maintainer
paypal.easy 1.25.5.2
PayPal Library is a powerful and easy-to-integrate .NET library designed to streamline PayPal pay...
5 versions - Latest release: 3 months ago - 791 downloads total - 3 stars on GitHub - 1 maintainer
lexepars.grammars.yaml 0.1.0
YAML grammar based on Lexepars parser lib.
3 versions - Latest release: almost 6 years ago - 70.2 thousand downloads total - 2 stars on GitHub - 1 maintainer
blism.language.yaml 1.3.2
A simple syntax highlighter library for Blazor.
6 versions - Latest release: 4 months ago - 1.2 thousand downloads total - 2 stars on GitHub - 1 maintainer
uralicnlp 1.0.0 💰
An NLP library for many languages.
1 version - Latest release: over 1 year ago - 225 downloads total - 3 stars on GitHub - 1 maintainer
bitcoincore 1.0.25
Bitcoin Core is a powerful and fully-featured C# library for building Bitcoin applications on the...
32 versions - Latest release: 14 days ago - 2.53 million downloads total - 0 stars on GitHub - 1 maintainer
textmatch 0.6.5
TextMatch is a library for searching inside texts using Lucene query expressions. Supports all ty...
3 versions - Latest release: over 9 years ago - 12.3 thousand downloads total - 4 stars on GitHub - 1 maintainer
autypo.aspnetcore 1.0.0
Autypo is a blazing-fast .NET library for fuzzy autocomplete, typo correction, and short-string s...
1 version - Latest release: 22 days ago - 0 downloads total - 1 maintainer
autypo 1.0.0
Autypo is a blazing-fast .NET library for fuzzy autocomplete, typo correction, and short-string s...
1 version - Latest release: 22 days ago - 0 downloads total - 1 maintainer
tokenevaluator.net 1.0.8 💰
TokenEvaluator.Net is a simple and useful library designed to measure and calculate the token cou...
8 versions - Latest release: over 1 year ago - 3.03 thousand downloads total - 2 stars on GitHub - 1 maintainer
hamedstack.syntaxmania 1.0.0
Package Description
1 version - Latest release: almost 2 years ago - 1 stars on GitHub - 1 maintainer
cynic-magnit.tokenization 1.0.1
Tokenize strings into custom tokens using ordered regex operations.
2 versions - Latest release: almost 3 years ago - 1 dependent package - 1.21 thousand downloads total - 1 stars on GitHub - 1 maintainer
Top 8.5% on nuget.org
lexepars.grammars.json 1.0.0
JSON grammar based on Lexepars parser lib.
1 version - Latest release: about 6 years ago - 1 dependent package - 33.2 thousand downloads total - 10 stars on GitHub - 1 maintainer
Top 8.9% on nuget.org
lexepars 1.3.0
Concise monadic parser combinator library with separate lexer/parser phases and big-size input su...
5 versions - Latest release: over 3 years ago - 4 dependent packages - 21.4 thousand downloads total - 10 stars on GitHub - 1 maintainer
Top 9.7% on nuget.org
ai.dev.openai.gpt 1.0.2 💰
OpenAI GPT utils, e.g. GPT3 Tokenizer
3 versions - Latest release: almost 3 years ago - 4 dependent packages - 160 thousand downloads total - 99 stars on GitHub - 1 maintainer
blism.language.bash 1.3.2
A simple syntax highlighter library for Blazor.
5 versions - Latest release: 4 months ago - 1.06 thousand downloads total - 2 stars on GitHub - 1 maintainer
rosette_api 1.33.0
.Net (C#) Binding for Babel Street Analytics API
43 versions - Latest release: 4 months ago - 1 dependent repositories - 151 thousand downloads total - 1 maintainer