Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
npmjs.org "Tokenizer" keyword
@plkit/noun 1.0.2
A simple lexer for javascript3 versions - Latest release: almost 4 years ago - 2 dependent packages - 2 downloads last month - 1 maintainer
lucene-tokenizers 5.3.3
Port from Apache Lucene2 versions - Latest release: over 8 years ago - 2 dependent packages - 1 dependent repositories - 881 downloads last month - 1 maintainer
rwkv-tokenizer-node 1.0.5
RWKV / gpt-NeoX / Pythia, 0-dep tokenizer library, for nodejs6 versions - Latest release: about 1 year ago - 1 dependent package - 1 dependent repositories - 41 downloads last month - 4 stars on GitHub - 1 maintainer
@dmitrysoshnikov/lex-js 0.1.10
Lexer generator from RegExp spec10 versions - Latest release: over 3 years ago - 1 dependent package - 17 downloads last month - 10 stars on GitHub - 1 maintainer
kingchop 1.0.6 💰
A text tokenizing library that handles strings, by tokenizing them into arrays, depending on inte...7 versions - Latest release: 6 months ago - 13 downloads last month - 1 stars on GitHub - 1 maintainer
@coder-seb/tokenizer 1.0.10
Lexical tokenizer with grammar classes ready to go.10 versions - Latest release: over 2 years ago - 1 dependent package - 13 downloads last month - 1 maintainer
Top 3.1% on npmjs.org
19 versions - Latest release: over 2 years ago - 14 dependent packages - 152 dependent repositories - 50.6 thousand downloads last month - 59 stars on GitHub - 3 maintainers
wink-tokenizer 5.3.0
Multilingual tokenizer that automatically tags each token with its type19 versions - Latest release: over 2 years ago - 14 dependent packages - 152 dependent repositories - 50.6 thousand downloads last month - 59 stars on GitHub - 3 maintainers
@enigmaoffline/node-exp-solver 1.0.4
Mathematical expression solver / Reverse Polish Notation calculator for NodeJS5 versions - Latest release: almost 3 years ago - 1 dependent package - 1 dependent repositories - 17 downloads last month - 1 stars on GitHub - 1 maintainer
libcore-tokenizer 0.1.8
NFA Tokenizer18 versions - Latest release: over 6 years ago - 3 dependent packages - 1 dependent repositories - 48 downloads last month - 0 stars on GitHub - 1 maintainer
is-tokenized 1.0.0 deprecated
is my text tokenized?1 version - Latest release: 6 months ago - 12 downloads last month - 0 stars on GitHub - 1 maintainer
Related Keywords
Lexer
2
nodejs
2
latin
1
konkani
1
hindi
1
german
1
french
1
devanagari
1
wink
1
Icelandic
1
Spanish
1
German
1
French
1
Multilingual
1
Emoticon
1
Emoji
1
URL
1
twitter
1
email
1
NLP
1
ES5
1
Non-Deterministic
1
Finite
1
Automaton
1
Automata
1
libcore
1
rpn-expression
1
rpn-calculator
1
rpn
1
equation-solver
1
Mathematical Expression
1
Equation
1
Solver
1
RPN
1
tokenizer
1
tokenization
1
tagging
1
multilingual
1
marathi
1
flexible text tokenizer
1
node.js tokenizer
1
text tokenizer
1
Sentence tokenizer
1
NLP tokenizer
1
JavaScript
1
Scanner
1
Token
1
Parser
1
RegExp
1
pythia
1
gpt-neox
1
neox
1
RWKV
1
JFlex
1
Lucene
1
Noun.js
1
Language
1
Tagging
1
Tags
1
Tokenize
1
coder-seb
1
word-tokenizer
1
tokenizers
1
text-tokenization
1
text-processing
1
sentence-tokenizer
1
paragraph-tokenizer
1
natural-language-processing
1
javascript
1
new text tokenizer
1
easy text tokenizer
1
stable tokenizer
1
sub sentence tokenizer
1
paragraph tokenizer
1
general text tokenizer
1