Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

nuget.org "tokenization" keyword

cynic-magnit.tokenization 1.0.1
Tokenize strings into custom tokens using ordered regex operations.
2 versions - Latest release: over 1 year ago - 1 dependent package - 1.04 thousand downloads total - 1 stars on GitHub - 1 maintainer
Top 9.7% on nuget.org
ai.dev.openai.gpt 1.0.2 💰
OpenAI GPT utils, e.g. GPT3 Tokenizer
3 versions - Latest release: over 1 year ago - 4 dependent packages - 89.4 thousand downloads total - 95 stars on GitHub - 1 maintainer
fastberttokenizer 1.0.28
Fast and memory-efficient WordPiece tokenizer as it is used by BERT and others. Tokenizes text fo...
10 versions - Latest release: 15 days ago - 20 thousand downloads total - 22 stars on GitHub - 1 maintainer
textmatch 0.6.5
TextMatch is a library for searching inside texts using Lucene query expressions. Supports all ty...
3 versions - Latest release: over 8 years ago - 11.5 thousand downloads total - 4 stars on GitHub - 1 maintainer
lexepars.grammars.yaml 0.1.0
YAML grammar based on Lexepars parser lib.
3 versions - Latest release: over 4 years ago - 69.8 thousand downloads total - 2 stars on GitHub - 1 maintainer
mcbits.tokenization 2.0.0
Extract tokens from a string of text for use with NLP tools or statistical analysis.
5 versions - Latest release: over 5 years ago - 1 dependent package - 5.87 thousand downloads total - 1 maintainer
Top 8.5% on nuget.org
lexepars.grammars.json 1.0.0
JSON grammar based on Lexepars parser lib.
1 version - Latest release: almost 5 years ago - 1 dependent package - 33.1 thousand downloads total - 7 stars on GitHub - 1 maintainer
alumis.text.tokenization 1.0.9
Text tokenization based on Unicode grapheme clustering, and the XID_Start and XID_Continue binary...
10 versions - Latest release: about 5 years ago - 5.85 thousand downloads total - 1 maintainer
metaparser 1.0.7
Package Description
14 versions - Latest release: about 1 year ago - 3.83 thousand downloads total - 1 maintainer
Top 9.1% on nuget.org
cybersource.flex.server 0.2.2
SDK for server-side integration with CyberSource Flex API
3 versions - Latest release: over 5 years ago - 1 dependent repositories - 36.5 thousand downloads total - 19 stars on GitHub - 1 maintainer
Top 8.9% on nuget.org
lexepars 1.3.0
Concise monadic parser combinator library with separate lexer/parser phases and big-size input su...
5 versions - Latest release: over 2 years ago - 4 dependent packages - 18.3 thousand downloads total - 7 stars on GitHub - 1 maintainer
lexepars.testfixtures 1.3.0
Package Description
3 versions - Latest release: over 2 years ago - 69.6 thousand downloads total - 7 stars on GitHub - 1 maintainer
tokenevaluator.net 1.0.8 💰
TokenEvaluator.Net is a simple and useful library designed to measure and calculate the token cou...
8 versions - Latest release: 5 months ago - 1.18 thousand downloads total - 1 stars on GitHub - 1 maintainer
hamedstack.syntaxmania 1.0.0
Package Description
1 version - Latest release: 8 months ago - 115 downloads total - 0 stars on GitHub - 1 maintainer
uralicnlp 1.0.0 💰
An NLP library for many languages.
1 version - Latest release: 3 months ago - 112 downloads total - 2 stars on GitHub - 1 maintainer
stanford.nlp.segmenter 4.2.0
Tokenization of raw text is a standard pre-processing step for many NLP tasks. For English, token...
16 versions - Latest release: about 3 years ago - 22.8 thousand downloads total - 1 maintainer
rosette_api 1.29.0
.Net (C#) Binding for Rosette API
40 versions - Latest release: 26 days ago - 1 dependent repositories - 140 thousand downloads total - 1 maintainer