Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
nuget.org "tokenization" keyword
cynic-magnit.tokenization 1.0.1
Tokenize strings into custom tokens using ordered regex operations.2 versions - Latest release: over 1 year ago - 1 dependent package - 1.04 thousand downloads total - 1 stars on GitHub - 1 maintainer
Top 9.7% on nuget.org
3 versions - Latest release: over 1 year ago - 4 dependent packages - 89.4 thousand downloads total - 95 stars on GitHub - 1 maintainer
ai.dev.openai.gpt 1.0.2 💰
OpenAI GPT utils, e.g. GPT3 Tokenizer3 versions - Latest release: over 1 year ago - 4 dependent packages - 89.4 thousand downloads total - 95 stars on GitHub - 1 maintainer
fastberttokenizer 1.0.28
Fast and memory-efficient WordPiece tokenizer as it is used by BERT and others. Tokenizes text fo...10 versions - Latest release: 15 days ago - 20 thousand downloads total - 22 stars on GitHub - 1 maintainer
textmatch 0.6.5
TextMatch is a library for searching inside texts using Lucene query expressions. Supports all ty...3 versions - Latest release: over 8 years ago - 11.5 thousand downloads total - 4 stars on GitHub - 1 maintainer
lexepars.grammars.yaml 0.1.0
YAML grammar based on Lexepars parser lib.3 versions - Latest release: over 4 years ago - 69.8 thousand downloads total - 2 stars on GitHub - 1 maintainer
mcbits.tokenization 2.0.0
Extract tokens from a string of text for use with NLP tools or statistical analysis.5 versions - Latest release: over 5 years ago - 1 dependent package - 5.87 thousand downloads total - 1 maintainer
Top 8.5% on nuget.org
1 version - Latest release: almost 5 years ago - 1 dependent package - 33.1 thousand downloads total - 7 stars on GitHub - 1 maintainer
lexepars.grammars.json 1.0.0
JSON grammar based on Lexepars parser lib.1 version - Latest release: almost 5 years ago - 1 dependent package - 33.1 thousand downloads total - 7 stars on GitHub - 1 maintainer
alumis.text.tokenization 1.0.9
Text tokenization based on Unicode grapheme clustering, and the XID_Start and XID_Continue binary...10 versions - Latest release: about 5 years ago - 5.85 thousand downloads total - 1 maintainer
metaparser 1.0.7
Package Description14 versions - Latest release: about 1 year ago - 3.83 thousand downloads total - 1 maintainer
Top 9.1% on nuget.org
3 versions - Latest release: over 5 years ago - 1 dependent repositories - 36.5 thousand downloads total - 19 stars on GitHub - 1 maintainer
cybersource.flex.server 0.2.2
SDK for server-side integration with CyberSource Flex API3 versions - Latest release: over 5 years ago - 1 dependent repositories - 36.5 thousand downloads total - 19 stars on GitHub - 1 maintainer
Top 8.9% on nuget.org
5 versions - Latest release: over 2 years ago - 4 dependent packages - 18.3 thousand downloads total - 7 stars on GitHub - 1 maintainer
lexepars 1.3.0
Concise monadic parser combinator library with separate lexer/parser phases and big-size input su...5 versions - Latest release: over 2 years ago - 4 dependent packages - 18.3 thousand downloads total - 7 stars on GitHub - 1 maintainer
lexepars.testfixtures 1.3.0
Package Description3 versions - Latest release: over 2 years ago - 69.6 thousand downloads total - 7 stars on GitHub - 1 maintainer
tokenevaluator.net 1.0.8 💰
TokenEvaluator.Net is a simple and useful library designed to measure and calculate the token cou...8 versions - Latest release: 5 months ago - 1.18 thousand downloads total - 1 stars on GitHub - 1 maintainer
hamedstack.syntaxmania 1.0.0
Package Description1 version - Latest release: 8 months ago - 115 downloads total - 0 stars on GitHub - 1 maintainer
uralicnlp 1.0.0 💰
An NLP library for many languages.1 version - Latest release: 3 months ago - 112 downloads total - 2 stars on GitHub - 1 maintainer
stanford.nlp.segmenter 4.2.0
Tokenization of raw text is a standard pre-processing step for many NLP tasks. For English, token...16 versions - Latest release: about 3 years ago - 22.8 thousand downloads total - 1 maintainer
rosette_api 1.29.0
.Net (C#) Binding for Rosette API40 versions - Latest release: 26 days ago - 1 dependent repositories - 140 thousand downloads total - 1 maintainer
Related Keywords
parsing
7
parser
6
tokenizer
5
lexer
5
nlp
4
text
4
parse-trees
4
parser-library
4
parsers
4
tokens
3
parsing-library
3
parsing-expression-grammars
3
parsing-expression-grammar
3
parsing-combinators
3
parser-framework
3
parser-engine
3
parser-combinators
3
fparsec
3
grammars
3
monadic
3
monadic-parser-combinators
3
off-side
3
parsec
3
parser-api
3
token
3
lemmatization
2
llm
2
ai
2
match
2
fuzzy
2
combinator
2
top-down-parser
1
tokenizing
1
tokenizer-parser
1
recusive-parser
1
recursive-descent-parser
1
lexing
1
lexer-parser
1
dotnetcore
1
dotnet-core
1
dotnet
1
csharp-library
1
English
1
Finnish
1
Spanish
1
RosetteAPI
1
IKVM
1
splitting
1
French
1
segmenter
1
Italian
1
stanford
1
German
1
Russian
1
embeddings
1
analytics
1
analysis
1
sentiment
1
vectors
1
semantic
1
rosette
1
relationships
1
record
1
speech
1
of
1
parts
1
ner
1
translation
1
deduplication
1
name
1
morphology
1
identity
1
identification
1
matching
1
event
1
linking
1
extraction
1
entity
1
coreference
1
categories
1
street
1
babel
1
language
1
analyze
1
similarity
1
address
1
validation
1
grammar
1
yaml
1
stemming
1
wildcard
1
search
1
wordpiece-tokenization
1
nlp-machine-learning
1
natural-language-processing
1
bert-embeddings
1
machine-learning
1
ml
1
artificial-intelligence
1
performance
1