Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
nuget.org "tokenizer" keyword
loretta.codeanalysis.common 0.2.12
A shared package used by Loretta. Do not install this package manually, it will be ad...5 versions - Latest release: 2 months ago - 1 dependent package - 7.89 thousand downloads total - 102 stars on GitHub - 1 maintainer
loretta.codeanalysis.lua 0.2.12
A GLua/Lua lexer, parser, code analysis, transformation and generation library.5 versions - Latest release: 2 months ago - 1 dependent package - 7.07 thousand downloads total - 102 stars on GitHub - 1 maintainer
loretta.codeanalysis.lua.experimental 0.2.12
Experimental code that might become part of Loretta.CodeAnalysis.Lua.5 versions - Latest release: 2 months ago - 5.45 thousand downloads total - 102 stars on GitHub - 1 maintainer
sharptoken 2.0.3
Package Description36 versions - Latest release: 1 day ago - 11 dependent packages - 648 thousand downloads total - 167 stars on GitHub - 1 maintainer
wquery 1.0.0
WQuery enables parsing and then editing a HTML code with the assistance of a fluent interface jus...3 versions - Latest release: over 124 years ago - 1 dependent package
whtmlparser 1.0.0
WHtmlParser is HTML code parser which works fast and does not have limitations imposed by parsers...3 versions - Latest release: over 124 years ago - 1 dependent package
tortoise 0.1.1
Package Description7 versions - Latest release: almost 2 years ago - 3 dependent packages - 2.26 thousand downloads total - 1 maintainer
softcircuits.parsing.helper 5.1.0
A .NET class library that makes it easier to parse text. The library tracks the current position ...40 versions - Latest release: 2 months ago - 3 dependent packages - 23.6 thousand downloads total - 11 stars on GitHub - 1 maintainer
msl.lexi 1.0.3
Lexi: A regular expression based lexer for dotnet.4 versions - Latest release: 3 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
prismsharp 1.0.0-beta
PrismSharp is a syntax highlighting library based on an excellent javascript library PrismJS, ful...1 version - Latest release: about 2 years ago - 1 dependent package - 0 stars on GitHub
mjml.net.htmlperformancekit 0.8.3
HtmlPerformanceKit is a fast HTML parser whith a similar API as XmlReader.4 versions - Latest release: 3 months ago - 1 dependent package - 1.74 thousand downloads total - 3 stars on GitHub - 1 maintainer
llmsharp.anthropic.tokenizer 2.0.3
Anthropic Claude BPE Tokenizer unofficial implementation6 versions - Latest release: 8 months ago - 1 dependent package - 14.1 thousand downloads total - 10 stars on GitHub - 1 maintainer
htmlperformancekit 1.0.0
HtmlPerformanceKit is a fast HTML parser.11 versions - Latest release: 3 months ago - 2 dependent packages - 137 thousand downloads total - 3 stars on GitHub - 1 maintainer
fastberttokenizer 1.0.28
Fast and memory-efficient WordPiece tokenizer as it is used by BERT and others. Tokenizes text fo...10 versions - Latest release: 18 days ago - 2 dependent packages - 20 thousand downloads total - 22 stars on GitHub - 1 maintainer
cynic-magnit.tokenization 1.0.1
Tokenize strings into custom tokens using ordered regex operations.2 versions - Latest release: over 1 year ago - 1 dependent package - 1.04 thousand downloads total - 1 stars on GitHub - 1 maintainer
allminilml6v2sharp 0.0.2
NET Standard 2.1 library to produces embeddings using C# Bert Tokenizer and Onnx All-Mini-LM-L6-v...2 versions - Latest release: about 1 month ago - 589 downloads total - 2 stars on GitHub - 1 maintainer
Top 9.7% on nuget.org
3 versions - Latest release: over 1 year ago - 4 dependent packages - 89.4 thousand downloads total - 95 stars on GitHub - 1 maintainer
ai.dev.openai.gpt 1.0.2 💰
OpenAI GPT utils, e.g. GPT3 Tokenizer3 versions - Latest release: over 1 year ago - 4 dependent packages - 89.4 thousand downloads total - 95 stars on GitHub - 1 maintainer
tweekenizer 1.0.0
Tokenizer for social media posts and comments1 version - Latest release: over 3 years ago - 1 maintainer
visualfa.compiler 1.2.0
Adds dynamic compilation support for the Visual FA runtime3 versions - Latest release: 16 days ago - 172 downloads total - 1 maintainer
visualfa.sourcegenerator 1.4.0
Generates fast DFA lexers and matchers in C# during the build process7 versions - Latest release: 16 days ago - 587 downloads total - 1 maintainer
Top 3.1% on nuget.org
28 versions - Latest release: over 3 years ago - 4 dependent packages - 4 dependent repositories - 348 thousand downloads total - 47 stars on GitHub - 1 maintainer
tokenizer 2.2.2
Tokenizer extracts structured information from blocks of text and reflects them onto .NET objects28 versions - Latest release: over 3 years ago - 4 dependent packages - 4 dependent repositories - 348 thousand downloads total - 47 stars on GitHub - 1 maintainer
virastyar.data 2.0.0
Required data files for Virastyar library.2 versions - Latest release: over 12 years ago - 3.82 thousand downloads total - 1 maintainer
inglish 1.0.0
This is C# port of 'Inglish language' parser created in 1983 for 'The Hobbit' C64 video game1 version - Latest release: over 124 years ago
vforteli.wordpiecetokenizer 0.1.0
Wordpiece tokenizer for using eg onnx models with ML.Net1 version - Latest release: 19 days ago - 0 downloads total - 1 stars on GitHub - 1 maintainer
nreco.nlquery 1.1.1
NLQuery: natural language query parser recognizes entities in context of structured sources (like...4 versions - Latest release: over 1 year ago - 9.84 thousand downloads total - 6 stars on GitHub - 1 maintainer
virastyar 2.0.0
A Farsi (Persian) language checking and NLP library. This package includes both library and it's ...3 versions - Latest release: over 12 years ago - 2 dependent repositories - 5.41 thousand downloads total - 1 maintainer
htmlspeedpack 0.2.0
HtmlSpeedPack is a fast HTML parser whith a similar API as XmlReader.2 versions - Latest release: over 124 years ago
Top 8.2% on nuget.org
4 versions - Latest release: over 8 years ago - 1 dependent package - 2 dependent repositories - 6.07 thousand downloads total - 496 stars on GitHub - 1 maintainer
vbf.compilers.scanners 1.0.5
VBF.Compilers.Scanners is a scanner builder. It contains a regular expression to DFA engine, can ...4 versions - Latest release: over 8 years ago - 1 dependent package - 2 dependent repositories - 6.07 thousand downloads total - 496 stars on GitHub - 1 maintainer
stringes 1.4.8
The Stringe is a wrapper for the .NET String object that tracks line, column, offset, and other m...13 versions - Latest release: over 8 years ago - 1 dependent repositories - 15.6 thousand downloads total - 1 maintainer
virastyar.lib 2.0.0
A Farsi (Persian) language checking and NLP library.2 versions - Latest release: over 12 years ago - 3.76 thousand downloads total - 1 maintainer
Top 7.3% on nuget.org
8 versions - Latest release: over 4 years ago - 1 dependent package - 2 dependent repositories - 102 thousand downloads total - 9 stars on GitHub - 1 maintainer
jokenizer.net 1.1.1
C# Expression parser and evaluator, inspired from jokenizer project.8 versions - Latest release: over 4 years ago - 1 dependent package - 2 dependent repositories - 102 thousand downloads total - 9 stars on GitHub - 1 maintainer
conekta.xamarin 1.0.6
Tokenizador (Xamarin) para Conekta. Necesitas tener alguna libreria de servidor para usar el token.5 versions - Latest release: about 9 years ago - 2 dependent repositories - 12.4 thousand downloads total - 2 stars on GitHub - 1 maintainer
owl 1.0.5407.37498
A html preprocessor which allows you to write html code using a beautiful syntax4 versions - Latest release: over 9 years ago - 6.41 thousand downloads total - 5 stars on GitHub - 1 maintainer
leeax.parsing.css 1.0.0-beta
A lightweight CSS tokenizer/parser with no dependencies.1 version - Latest release: over 3 years ago
metaparser 1.0.7
Package Description14 versions - Latest release: about 1 year ago - 3.83 thousand downloads total - 1 maintainer
gparse.extensions.statemachines 5.0.0-alpha09
Extension methods to integrate GParse with Tsu.StateMachines4 versions - Latest release: almost 3 years ago - 1 stars on GitHub
apcsharp 1.0.8
Another Parser Combinator for C#. A library for building optimized and flexible parsers.9 versions - Latest release: about 3 years ago - 3.57 thousand downloads total - 1 maintainer
nltknet 1.0.14
NLTK python library wrapper for .NET14 versions - Latest release: over 3 years ago - 1 dependent repositories - 12.7 thousand downloads total - 44 stars on GitHub - 1 maintainer
brainfuck-runner 1.0.14 💰
Powerful Brainfuck language interpreter with ability to tokenize & validate the Brainfuck code13 versions - Latest release: over 2 years ago - 9.71 thousand downloads total - 2 stars on GitHub - 1 maintainer
cledev.openai 1.1.0
.NET SDK for OpenAI.20 versions - Latest release: about 1 year ago - 3.36 thousand downloads total - 103 stars on GitHub - 1 maintainer
brainfuckrunner.library 1.0.1
Powerful Brainfuck language interpreter along with ability to tokenize & validate the Brainfuck code2 versions - Latest release: over 124 years ago
tokencs 1.0.5
A simple library to abstract the gritty process of lexical parsing.6 versions - Latest release: almost 2 years ago - 2.21 thousand downloads total - 1 maintainer
Top 9.9% on nuget.org
4 versions - Latest release: over 124 years ago - 1 dependent package - 1 dependent repositories - 1 stars on GitHub
gparse 5.0.0-alpha09
Parsing and lexing utilities to create your own parser and lexer4 versions - Latest release: over 124 years ago - 1 dependent package - 1 dependent repositories - 1 stars on GitHub
stirlinglabs.stringtoexpression 23.1.1
StringToExpression allows you to create methods that take strings and outputs .NET expressions. ...6 versions - Latest release: over 1 year ago - 3.47 thousand downloads total - 1 stars on GitHub - 1 maintainer
openai.net.sdk 1.0.0-preview-2023-02-12-5
.NET SDK for OpenAI.13 versions - Latest release: over 1 year ago - 98 stars on GitHub
bytecodeapi.lexer 3.0.1
General purpose tokenizer for parsing of any syntax.2 versions - Latest release: 8 months ago - 251 downloads total - 1 maintainer
haceau.json 1.1.0
一个简易的JSON解析器。2 versions - Latest release: almost 4 years ago - 904 downloads total - 1 stars on GitHub - 1 maintainer
hamedstack.syntaxmania 1.0.0
Package Description1 version - Latest release: 8 months ago - 115 downloads total - 0 stars on GitHub - 1 maintainer
parsertoolkit 1.3.0 💰
Package Description7 versions - Latest release: 12 months ago - 2.34 thousand downloads total - 5 stars on GitHub - 1 maintainer
llmsharp.openai.tokenizer 2.0.3
Open AI Chat Completion Models (GPT 3.5/GPT 4) BPE Tokenizer unofficial implementation6 versions - Latest release: 8 months ago - 4.17 thousand downloads total - 10 stars on GitHub - 1 maintainer
xlemmatizer 0.1.0
Pre-release version. API might change later. A lemma is the canonical form of the word. For exam...1 version - Latest release: almost 4 years ago - 842 downloads total - 1 maintainer
portedfastberttokenizer 0.4.6-beta
Fast and memory-efficient WordPiece tokenizer as it is used by BERT and others. Tokenizes text fo...1 version - Latest release: 6 months ago - 0 stars on GitHub
Related Keywords
parser
24
lexer
18
parsing
11
csharp
9
dotnet
8
language
7
lexing
6
tokenizing
6
openai
6
token
6
c-sharp
5
tokenization
5
gpt-3
4
nlp
4
lexical
4
parse
4
regex
4
.net
4
scanner
4
lemmatizer
4
NLP
4
grammar
3
morphology
3
syntax
3
html
3
datetime
3
persian
3
bert
3
wordpiece
3
llm
3
farsi
3
unicode
3
tokens
3
transliterator
3
gpt3
3
compiler
3
spell-checker
3
expression
3
lua-lexer
3
query
3
luau
3
roblox-lua
3
lua
3
text
3
glua
3
ast-transformations
3
garrysmodlua
3
code-generator
3
code-analysis
3
gpt-4
3
engine
3
HTML
3
chatgpt-api
2
chatgpt-4
2
lexer-framework
2
dall-e
2
gpt
2
dontnet-core
2
net7
2
openai-api
2
sdk
2
sdk-dotnet
2
whisper
2
HTML5
2
dotnet-standard
2
parser-framework
2
tokenizer-framework
2
xamarin
2
conekta
2
bscheiman
2
scheiman
2
boris
2
brainfuck
2
interpreter
2
netcore
2
validator
2
core
2
utilities
2
extensions
2
client
2
azureopenai
2
NER
2
blazor
2
blazor-server
2
chat-gpt
2
chatgpt
2
natural-language-processing
2
machine-learning
2
ml
2
artificial-intelligence
2
ai
2
performance
2
semantic-kernel
2
CSS3
2
jQuery
2
gpt-35-turbo
2
bpe
2
tiktoken
2
claude
2
anthropic
2