Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
npmjs.org "tokenization" keyword
Top 7.0% on npmjs.org
25 versions - Latest release: 7 months ago - 9 dependent packages - 11 dependent repositories - 622 downloads last month - 11 stars on GitHub - 1 maintainer
words-n-numbers 9.1.2
Tokenizing strings of text. Extracting arrays of words and optionally number, emojis, tags, usern...25 versions - Latest release: 7 months ago - 9 dependent packages - 11 dependent repositories - 622 downloads last month - 11 stars on GitHub - 1 maintainer
tokenize-sync 2.0.0 💰
Simple synchronous string tokenizer using Regex2 versions - Latest release: over 6 years ago - 3 dependent packages - 2 dependent repositories - 29 downloads last month - 1 stars on GitHub - 1 maintainer
Top 7.1% on npmjs.org
5 versions - Latest release: about 1 year ago - 2 dependent packages - 7 dependent repositories - 3.06 thousand downloads last month - 11 stars on GitHub - 1 maintainer
gpt-token-utils 1.2.0
Isomorphic utilities for GPT-3 tokenization and prompt building.5 versions - Latest release: about 1 year ago - 2 dependent packages - 7 dependent repositories - 3.06 thousand downloads last month - 11 stars on GitHub - 1 maintainer
Top 8.7% on npmjs.org
3 versions - Latest release: over 9 years ago - 4 dependent packages - 5 dependent repositories - 38 downloads last month - 241 stars on GitHub - 1 maintainer
salient 0.3.0
Salient is a natural language processing and sentiment analysis library3 versions - Latest release: over 9 years ago - 4 dependent packages - 5 dependent repositories - 38 downloads last month - 241 stars on GitHub - 1 maintainer
javascript-recognize 1.3.2
6 versions - Latest release: over 4 years ago - 1 dependent package - 1 dependent repositories - 11 downloads last month - 0 stars on GitHub - 1 maintainersalient_for_meteor 0.2.1
Salient is a natural language processing and sentiment analysis library2 versions - Latest release: over 8 years ago - 17 downloads last month - 241 stars on GitHub - 1 maintainer
jquery-tokenizer 1.0.0
A jQuery tool to tokenizer value on input1 version - Latest release: over 7 years ago - 1 dependent package - 1 dependent repositories - 12 downloads last month - 0 stars on GitHub - 1 maintainer
lunasec-cli 0.0.1-alpha.14
a wrapper around the LunaSec CLI enabling it to be used as an NPM package1 version - Latest release: over 2 years ago - 1 dependent package - 5 downloads last month - 1 maintainer
@lunasec/cli 1.0.7
a wrapper around the LunaSec CLI enabling it to be used as an NPM package24 versions - Latest release: over 2 years ago - 1 dependent package - 1 dependent repositories - 28 downloads last month - 3 maintainers
vscode-textmate-languageservice 3.0.1
Textmate token-based language service for Visual Studio Code.25 versions - Latest release: 4 months ago - 1 dependent repositories - 49 downloads last month - 11 stars on GitHub - 1 maintainer
pruf-js 0.5.2
An interface to the pruf network written in javascript41 versions - Latest release: almost 2 years ago - 1 dependent package - 46 downloads last month - 0 stars on GitHub - 1 maintainer
tokenize-words 0.0.4-alpha.0
Break down text into array of words.4 versions - Latest release: about 1 year ago - 4 dependent packages - 24 downloads last month - 0 stars on GitHub - 1 maintainer
taibun 1.0.2
Taiwanese Hokkien Transliterator and Tokeniser8 versions - Latest release: 19 days ago - 363 downloads last month - 1 stars on GitHub - 1 maintainer
tasknization 1.0.3
Define a function to execute after completing token-defined tasks.2 versions - Latest release: over 4 years ago - 1 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
sentence-tools 4.0.0
Tools for manipulating sentences8 versions - Latest release: almost 5 years ago - 2 dependent packages - 7 dependent repositories - 34 downloads last month - 8 stars on GitHub - 1 maintainer
llm-distillery 1.0.10
Use LLMs to run map-reduce summarization tasks on large documents until a target token size is met.12 versions - Latest release: 19 days ago - 572 downloads last month - 3 stars on GitHub - 1 maintainer
andreihar-example 0.0.4 unpublished
Taiwanese Hokkien Transliterator and Tokeniser4 versions - Latest release: about 1 month ago - 1 maintainer
@bridgesplit/rwa-token-sdk 0.0.2
RWA Token SDK for the development of permissioned tokens on SVM blockchains.3 versions - Latest release: 30 days ago - 137 downloads last month - 7 stars on GitHub - 4 maintainers
pos-tokenizer 1.0.0
POS tokenization of words int meaningful components usable in POS-Bayes & Elastic Search Indexes1 version - Latest release: almost 9 years ago - 1 dependent package - 1 dependent repositories - 9 downloads last month - 2 stars on GitHub - 1 maintainer
ascca-token-client 1.2.0
API client for token processing by connecting to assca8 versions - Latest release: over 5 years ago - 2 dependent packages - 1 dependent repositories - 545 downloads last month - 1 maintainer
arajs 1.0.13
An npm module that provides Arabic language processing capabilities for JavaScript applications, ...14 versions - Latest release: about 1 year ago - 1 dependent package - 35 downloads last month - 3 stars on GitHub - 1 maintainer
bedrock-tokenizer 6.0.0
A Bedrock module to provide auto-rotating tokenizers10 versions - Latest release: about 2 years ago - 1 dependent package - 34 downloads last month - 0 stars on GitHub - 5 maintainers
@bedrock/tokenizer 10.0.0
A Bedrock module to provide auto-rotating tokenizers8 versions - Latest release: 9 months ago - 1 dependent package - 3 dependent repositories - 208 downloads last month - 0 stars on GitHub - 5 maintainers
ff3 1.0.1
NIST standard Format-preserving encryption FF3-1 implementation5 versions - Latest release: about 2 years ago - 1 dependent package - 1 dependent repositories - 17.1 thousand downloads last month - 26 stars on GitHub - 1 maintainer
@basis-theory/apple-pay-js 2.0.2
Basis Theory utility for decrypting Apple Pay Tokens6 versions - Latest release: 4 months ago - 1.52 thousand downloads last month - 0 stars on GitHub - 11 maintainers
natural-cli 0.0.8
CLI tool to perform NLP on selected files8 versions - Latest release: 9 months ago - 13 downloads last month - 1 maintainer
@basis-theory/google-pay-js 1.0.0
Basis Theory utility for decrypting Google Pay Tokens1 version - Latest release: 3 months ago - 32 downloads last month - 0 stars on GitHub - 11 maintainers
skyflow-node 1.14.0
Skyflow SDK for Node.js34 versions - Latest release: 4 months ago - 2 dependent repositories - 14.2 thousand downloads last month - 4 stars on GitHub - 1 maintainer
tokenwise 0.3.6
GPT token estimation and context size utilities without a full tokenizer9 versions - Latest release: 19 days ago - 1.18 thousand downloads last month - 13 stars on GitHub - 1 maintainer
Top 5.3% on npmjs.org
55 versions - Latest release: 3 months ago - 4 dependent packages - 9 dependent repositories - 4.79 thousand downloads last month - 41 stars on GitHub - 1 maintainer
nlpcloud 2.0.5
NLP Cloud serves high performance pre-trained or custom models for NER, sentiment-analysis, class...55 versions - Latest release: 3 months ago - 4 dependent packages - 9 dependent repositories - 4.79 thousand downloads last month - 41 stars on GitHub - 1 maintainer
spliceation-transmutator.typescript 0.0.11
Well typed, string transmutation via splicing, driven by definitions of regular expressions, prio...11 versions - Latest release: 11 months ago - 1 dependent package - 1 dependent repositories - 19 downloads last month - 1 stars on GitHub - 1 maintainer
lexr 1.0.4
Lexical analyzer built in Javascript26 versions - Latest release: almost 6 years ago - 1 dependent package - 2 dependent repositories - 100 downloads last month - 15 stars on GitHub - 1 maintainer
lex-es6 1.1.0 💰
es6 version of aaditmshah/lexer4 versions - Latest release: over 8 years ago - 2 dependent packages - 1 dependent repositories - 9 downloads last month - 0 stars on GitHub - 1 maintainer
Top 5.2% on npmjs.org
15 versions - Latest release: over 3 years ago - 4 dependent packages - 4 dependent repositories - 3.65 thousand downloads last month - 35 stars on GitHub - 1 maintainer
html-tokenizer 4.0.1
Small, fast, event-driven, fault-tolerant html tokenizer. Works in node or browsers.15 versions - Latest release: over 3 years ago - 4 dependent packages - 4 dependent repositories - 3.65 thousand downloads last month - 35 stars on GitHub - 1 maintainer
@basd/search 0.0.5
A powerful and flexible text search library for JavaScript that enables you to build a simple tex...5 versions - Latest release: 6 months ago - 1 dependent package - 31 downloads last month - 0 stars on GitHub - 1 maintainer
ogden 1.0.6 💰
Basic English tokenizer7 versions - Latest release: almost 8 years ago - 1 dependent package - 1 dependent repositories - 11 downloads last month - 1 stars on GitHub - 1 maintainer
Top 8.4% on npmjs.org
1 version - Latest release: almost 2 years ago - 2 dependent packages - 4 dependent repositories - 421 downloads last month - 5 stars on GitHub - 7 maintainers
@doc-tools/sentenizer 0.0.0
text segmentation into sentences1 version - Latest release: almost 2 years ago - 2 dependent packages - 4 dependent repositories - 421 downloads last month - 5 stars on GitHub - 7 maintainers
jexer 0.2.0
a lexer in javascript1 version - Latest release: about 5 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 0 stars on GitHub - 1 maintainer
shunou 1.1.1
## How To Use25 versions - Latest release: about 2 months ago - 194 downloads last month - 0 stars on GitHub - 1 maintainer
@clipperhouse/jargon 0.3.0
A tokenizer and lemmatizer for canonical terms in text13 versions - Latest release: 25 days ago - 1 dependent package - 1 dependent repositories - 48 downloads last month - 2 stars on GitHub - 1 maintainer
@tokenf/contracts 0.2.0
On-chain Real World Assets Tokenization Framework3 versions - Latest release: about 2 months ago - 82 downloads last month - 13 stars on GitHub - 1 maintainer
creditcards-tokenizer 1.2.902
Wix Restaurants credit-cards tokenizer904 versions - Latest release: about 4 years ago - 1 dependent package - 1 dependent repositories - 1.25 thousand downloads last month - 3 stars on GitHub - 10 maintainers
@cybersource/flex-sdk-node 0.1.0
Easily create keys for use in a Flex API integration and verifying Flex token contents1 version - Latest release: about 6 years ago - 1 dependent package - 1 dependent repositories - 442 downloads last month - 4 maintainers
Top 6.4% on npmjs.org
6 versions - Latest release: about 4 years ago - 3 dependent packages - 1 dependent repositories - 8.88 thousand downloads last month - 19 stars on GitHub - 4 maintainers
@cybersource/flex-sdk-web 0.3.1
Easily create payment tokens using Flex API6 versions - Latest release: about 4 years ago - 3 dependent packages - 1 dependent repositories - 8.88 thousand downloads last month - 19 stars on GitHub - 4 maintainers
@diplodoc/sentenizer 0.0.8
text segmentation into sentences9 versions - Latest release: 3 months ago - 1 dependent package - 2 dependent repositories - 1.47 thousand downloads last month - 0 stars on GitHub - 9 maintainers
@dev-extralabs/web3 0.2.0
package to deploy the smart contracts that associate the tokens to the various clients proportion...4 versions - Latest release: 3 months ago - 14 downloads last month - 1 maintainer
@bedrock/tokenization 22.0.0
Bedrock Tokenization Engine23 versions - Latest release: 3 months ago - 1 dependent package - 1 dependent repositories - 99 downloads last month - 3 stars on GitHub - 5 maintainers
bedrock-tokenization 12.0.0
Bedrock Tokenization Engine24 versions - Latest release: about 2 years ago - 1 dependent package - 50 downloads last month - 3 stars on GitHub - 5 maintainers
porter-stemmer-js 1.1.2
Very fast Porter Stemmer implementation written in Javascript.6 versions - Latest release: about 1 month ago - 320 downloads last month - 0 stars on GitHub - 1 maintainer
@polyfact/vectorizer 1.0.5
Here is a README generated from the code snippet:6 versions - Latest release: 9 months ago - 17 downloads last month - 2 stars on GitHub - 3 maintainers
tiptap-annotation-magic 2.0.0
This is an extension for the [Tiptap](https://github.com/ueberdosis/tiptap) editor (based on Pros...9 versions - Latest release: 9 months ago - 46 downloads last month - 20 stars on GitHub - 1 maintainer
@steadyx/aether 0.0.21
A JSON parser implemented in TypeScript15 versions - Latest release: 9 months ago - 10 downloads last month - 1 stars on GitHub - 1 maintainer
@databunker/store 1.0.8
Databunker storage class for nodejs9 versions - Latest release: about 3 years ago - 1 dependent package - 1 dependent repositories - 15 downloads last month - 2 stars on GitHub - 1 maintainer
lexemic 0.0.8
Tools for working with human language data.8 versions - Latest release: almost 11 years ago - 1 dependent package - 1 dependent repositories - 13 downloads last month - 7 stars on GitHub - 1 maintainer
Top 5.6% on npmjs.org
11 versions - Latest release: about 7 years ago - 3 dependent packages - 16 dependent repositories - 370 downloads last month - 36 stars on GitHub - 1 maintainer
nlp-js-tools-french 1.0.9
POS Tagger and lemmatizer for javascript11 versions - Latest release: about 7 years ago - 3 dependent packages - 16 dependent repositories - 370 downloads last month - 36 stars on GitHub - 1 maintainer
@fat-token/fat-js 1.3.0
Factom Asset Token (FAT) library in JS16 versions - Latest release: over 4 years ago - 2 dependent packages - 2 dependent repositories - 23 downloads last month - 4 stars on GitHub - 2 maintainers
Top 3.1% on npmjs.org
19 versions - Latest release: over 2 years ago - 14 dependent packages - 152 dependent repositories - 50.6 thousand downloads last month - 59 stars on GitHub - 3 maintainers
wink-tokenizer 5.3.0
Multilingual tokenizer that automatically tags each token with its type19 versions - Latest release: over 2 years ago - 14 dependent packages - 152 dependent repositories - 50.6 thousand downloads last month - 59 stars on GitHub - 3 maintainers
@jwalab/tokenization-service-contracts 0.2.0
Tokenization Service's Smart Contracts12 versions - Latest release: over 2 years ago - 1 dependent package - 2 dependent repositories - 15 downloads last month - 0 stars on GitHub - 2 maintainers
Top 3.3% on npmjs.org
9 versions - Latest release: almost 8 years ago - 6 dependent packages - 34 dependent repositories - 2.04 thousand downloads last month - 366 stars on GitHub - 1 maintainer
az 0.2.3
A NLP library for Russian language9 versions - Latest release: almost 8 years ago - 6 dependent packages - 34 dependent repositories - 2.04 thousand downloads last month - 366 stars on GitHub - 1 maintainer
tinylex 0.7.4
A simple iterative lexer written in TypeScript21 versions - Latest release: about 5 years ago - 1 dependent package - 1 dependent repositories - 36 downloads last month - 3 stars on GitHub - 1 maintainer
@lunasec/log4shell 1.0.7-beta2 💰
Tools to help remediate the log4shell vulnerability.2 versions - Latest release: over 2 years ago - 8 downloads last month - 1,408 stars on GitHub - 3 maintainers
rosette-api 1.14.4
Rosette API Node.js client SDK34 versions - Latest release: almost 4 years ago - 3 dependent repositories - 225 downloads last month - 8 stars on GitHub - 2 maintainers
Top 1.7% on npmjs.org
21 versions - Latest release: almost 9 years ago - 53 dependent packages - 972 dependent repositories - 96.9 thousand downloads last month - 410 stars on GitHub - 1 maintainer
lex 1.7.9 deprecated 💰
An elegant armor-plated JavaScript lexer modelled after flex. Easily extensible to tailor to your...21 versions - Latest release: almost 9 years ago - 53 dependent packages - 972 dependent repositories - 96.9 thousand downloads last month - 410 stars on GitHub - 1 maintainer
lexed 1.0.10
English word and sentence tokenizer, for natural language processing.9 versions - Latest release: about 7 years ago - 5 dependent packages - 9 dependent repositories - 83 downloads last month - 3 stars on GitHub - 1 maintainer
tokenex 0.0.2 removed
TokenEX Node.js library for API2 versions - Latest release: almost 6 years ago - 1 dependent package - 1 dependent repositories - 12 downloads last month - 1 maintainer
code-vectorizer 1.0.3 unpublished
Code Vectorizer is a tool written in Typescript that helps you vectorize your code. This tool use...11 versions - Latest release: 10 months ago - 1 dependent repositories - 543 downloads last month - 0 stars on GitHub - 1 maintainer
dropsuit-tok 1.0.9 unpublished
DropSuit NLP - tok function: A JavaScript and Node.js library for tokenizing text9 versions - Latest release: over 1 year ago - 477 downloads last month - 1 stars on GitHub - 1 maintainer
skyflow-node-dev 1.0.1-beta.3 unpublished
Node js client for skyflow API's2 versions - Latest release: over 3 years ago - 9 downloads last month - 0 stars on - 1 maintainer
Related Keywords
tokenizer
26
nlp
18
token
11
javascript
11
tokenize
8
lexer
7
parser
6
flex
6
ai
5
text-processing
5
node
5
lex
5
natural-language-processing
5
natural
5
language
5
machine-learning
4
lexical
4
js
4
security
4
api
4
transliteration
4
categorization
4
speech
4
text-analysis
4
scanning
4
processing
4
nodejs
4
bedrock
4
parsing
3
json
3
sentence
3
scanner
3
NLP
3
lunasec
3
language-processing
3
typescript
3
information-retrieval
3
text-mining
3
taiwan
3
analysis
3
scan
3
russian
3
natural language processing
3
lexing
3
privacy
3
transliterator
3
words
3
lemmatization
3
romanization
3
taiwanese
3
of
3
taigi
3
hokkien
3
compliance
2
morphology
2
classification
2
normalization
2
encryption
2
pay
2
tagging
2
decrypt
2
detokenization
2
debundle
2
sentiment analysis
2
skyflow
2
stemming
2
vault
2
PII
2
language-detection
2
lexical analysis
2
gdpr
2
deep-learning
2
data-science
2
big-data
2
text-analytics
2
code-analytics
2
progress-tracking
2
programming-language
2
vector-space
2
dimensionality-reduction
2
text-vectorization
2
language-vectorization
2
batch-processing
2
code-analysis
2
neural-network-input
2
code-to-vector
2
feature-extraction
2
semantic-analysis
2
machine-code
2
source-code
2
algorithm
2
memory-creation
2
jison
2
text-search
2
AST
2
sentence-segmentation
2
credit cards
2
cybersource
2
payments
2
sdk
2