Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

npmjs.org "tokenization" keyword

Top 7.0% on npmjs.org
words-n-numbers 9.1.2
Tokenizing strings of text. Extracting arrays of words and optionally number, emojis, tags, usern...
25 versions - Latest release: 7 months ago - 9 dependent packages - 11 dependent repositories - 622 downloads last month - 11 stars on GitHub - 1 maintainer
tokenize-sync 2.0.0 💰
Simple synchronous string tokenizer using Regex
2 versions - Latest release: over 6 years ago - 3 dependent packages - 2 dependent repositories - 29 downloads last month - 1 stars on GitHub - 1 maintainer
Top 7.1% on npmjs.org
gpt-token-utils 1.2.0
Isomorphic utilities for GPT-3 tokenization and prompt building.
5 versions - Latest release: about 1 year ago - 2 dependent packages - 7 dependent repositories - 3.06 thousand downloads last month - 11 stars on GitHub - 1 maintainer
Top 8.7% on npmjs.org
salient 0.3.0
Salient is a natural language processing and sentiment analysis library
3 versions - Latest release: over 9 years ago - 4 dependent packages - 5 dependent repositories - 38 downloads last month - 241 stars on GitHub - 1 maintainer
javascript-recognize 1.3.2
6 versions - Latest release: over 4 years ago - 1 dependent package - 1 dependent repositories - 11 downloads last month - 0 stars on GitHub - 1 maintainer
salient_for_meteor 0.2.1
Salient is a natural language processing and sentiment analysis library
2 versions - Latest release: over 8 years ago - 17 downloads last month - 241 stars on GitHub - 1 maintainer
jquery-tokenizer 1.0.0
A jQuery tool to tokenizer value on input
1 version - Latest release: over 7 years ago - 1 dependent package - 1 dependent repositories - 12 downloads last month - 0 stars on GitHub - 1 maintainer
lunasec-cli 0.0.1-alpha.14
a wrapper around the LunaSec CLI enabling it to be used as an NPM package
1 version - Latest release: over 2 years ago - 1 dependent package - 5 downloads last month - 1 maintainer
@lunasec/cli 1.0.7
a wrapper around the LunaSec CLI enabling it to be used as an NPM package
24 versions - Latest release: over 2 years ago - 1 dependent package - 1 dependent repositories - 28 downloads last month - 3 maintainers
vscode-textmate-languageservice 3.0.1
Textmate token-based language service for Visual Studio Code.
25 versions - Latest release: 4 months ago - 1 dependent repositories - 49 downloads last month - 11 stars on GitHub - 1 maintainer
pruf-js 0.5.2
An interface to the pruf network written in javascript
41 versions - Latest release: almost 2 years ago - 1 dependent package - 46 downloads last month - 0 stars on GitHub - 1 maintainer
tokenize-words 0.0.4-alpha.0
Break down text into array of words.
4 versions - Latest release: about 1 year ago - 4 dependent packages - 24 downloads last month - 0 stars on GitHub - 1 maintainer
taibun 1.0.2
Taiwanese Hokkien Transliterator and Tokeniser
8 versions - Latest release: 19 days ago - 363 downloads last month - 1 stars on GitHub - 1 maintainer
tasknization 1.0.3
Define a function to execute after completing token-defined tasks.
2 versions - Latest release: over 4 years ago - 1 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
sentence-tools 4.0.0
Tools for manipulating sentences
8 versions - Latest release: almost 5 years ago - 2 dependent packages - 7 dependent repositories - 34 downloads last month - 8 stars on GitHub - 1 maintainer
llm-distillery 1.0.10
Use LLMs to run map-reduce summarization tasks on large documents until a target token size is met.
12 versions - Latest release: 19 days ago - 572 downloads last month - 3 stars on GitHub - 1 maintainer
andreihar-example 0.0.4 unpublished
Taiwanese Hokkien Transliterator and Tokeniser
4 versions - Latest release: about 1 month ago - 1 maintainer
@bridgesplit/rwa-token-sdk 0.0.2
RWA Token SDK for the development of permissioned tokens on SVM blockchains.
3 versions - Latest release: 30 days ago - 137 downloads last month - 7 stars on GitHub - 4 maintainers
pos-tokenizer 1.0.0
POS tokenization of words int meaningful components usable in POS-Bayes & Elastic Search Indexes
1 version - Latest release: almost 9 years ago - 1 dependent package - 1 dependent repositories - 9 downloads last month - 2 stars on GitHub - 1 maintainer
ascca-token-client 1.2.0
API client for token processing by connecting to assca
8 versions - Latest release: over 5 years ago - 2 dependent packages - 1 dependent repositories - 545 downloads last month - 1 maintainer
arajs 1.0.13
An npm module that provides Arabic language processing capabilities for JavaScript applications, ...
14 versions - Latest release: about 1 year ago - 1 dependent package - 35 downloads last month - 3 stars on GitHub - 1 maintainer
bedrock-tokenizer 6.0.0
A Bedrock module to provide auto-rotating tokenizers
10 versions - Latest release: about 2 years ago - 1 dependent package - 34 downloads last month - 0 stars on GitHub - 5 maintainers
@bedrock/tokenizer 10.0.0
A Bedrock module to provide auto-rotating tokenizers
8 versions - Latest release: 9 months ago - 1 dependent package - 3 dependent repositories - 208 downloads last month - 0 stars on GitHub - 5 maintainers
tokenizing 0.1.0
tokenizing text by rules
1 version - Latest release: 18 days ago - 1 maintainer
ff3 1.0.1
NIST standard Format-preserving encryption FF3-1 implementation
5 versions - Latest release: about 2 years ago - 1 dependent package - 1 dependent repositories - 17.1 thousand downloads last month - 26 stars on GitHub - 1 maintainer
@basis-theory/apple-pay-js 2.0.2
Basis Theory utility for decrypting Apple Pay Tokens
6 versions - Latest release: 4 months ago - 1.52 thousand downloads last month - 0 stars on GitHub - 11 maintainers
natural-cli 0.0.8
CLI tool to perform NLP on selected files
8 versions - Latest release: 9 months ago - 13 downloads last month - 1 maintainer
@basis-theory/google-pay-js 1.0.0
Basis Theory utility for decrypting Google Pay Tokens
1 version - Latest release: 3 months ago - 32 downloads last month - 0 stars on GitHub - 11 maintainers
skyflow-node 1.14.0
Skyflow SDK for Node.js
34 versions - Latest release: 4 months ago - 2 dependent repositories - 14.2 thousand downloads last month - 4 stars on GitHub - 1 maintainer
tokenwise 0.3.6
GPT token estimation and context size utilities without a full tokenizer
9 versions - Latest release: 19 days ago - 1.18 thousand downloads last month - 13 stars on GitHub - 1 maintainer
Top 5.3% on npmjs.org
nlpcloud 2.0.5
NLP Cloud serves high performance pre-trained or custom models for NER, sentiment-analysis, class...
55 versions - Latest release: 3 months ago - 4 dependent packages - 9 dependent repositories - 4.79 thousand downloads last month - 41 stars on GitHub - 1 maintainer
spliceation-transmutator.typescript 0.0.11
Well typed, string transmutation via splicing, driven by definitions of regular expressions, prio...
11 versions - Latest release: 11 months ago - 1 dependent package - 1 dependent repositories - 19 downloads last month - 1 stars on GitHub - 1 maintainer
lexr 1.0.4
Lexical analyzer built in Javascript
26 versions - Latest release: almost 6 years ago - 1 dependent package - 2 dependent repositories - 100 downloads last month - 15 stars on GitHub - 1 maintainer
lex-es6 1.1.0 💰
es6 version of aaditmshah/lexer
4 versions - Latest release: over 8 years ago - 2 dependent packages - 1 dependent repositories - 9 downloads last month - 0 stars on GitHub - 1 maintainer
Top 5.2% on npmjs.org
html-tokenizer 4.0.1
Small, fast, event-driven, fault-tolerant html tokenizer. Works in node or browsers.
15 versions - Latest release: over 3 years ago - 4 dependent packages - 4 dependent repositories - 3.65 thousand downloads last month - 35 stars on GitHub - 1 maintainer
jawi 0.0.1
Jawi
1 version - Latest release: 22 days ago - 1 maintainer
@basd/search 0.0.5
A powerful and flexible text search library for JavaScript that enables you to build a simple tex...
5 versions - Latest release: 6 months ago - 1 dependent package - 31 downloads last month - 0 stars on GitHub - 1 maintainer
ogden 1.0.6 💰
Basic English tokenizer
7 versions - Latest release: almost 8 years ago - 1 dependent package - 1 dependent repositories - 11 downloads last month - 1 stars on GitHub - 1 maintainer
Top 8.4% on npmjs.org
@doc-tools/sentenizer 0.0.0
text segmentation into sentences
1 version - Latest release: almost 2 years ago - 2 dependent packages - 4 dependent repositories - 421 downloads last month - 5 stars on GitHub - 7 maintainers
jexer 0.2.0
a lexer in javascript
1 version - Latest release: about 5 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 0 stars on GitHub - 1 maintainer
shunou 1.1.1
## How To Use
25 versions - Latest release: about 2 months ago - 194 downloads last month - 0 stars on GitHub - 1 maintainer
@clipperhouse/jargon 0.3.0
A tokenizer and lemmatizer for canonical terms in text
13 versions - Latest release: 25 days ago - 1 dependent package - 1 dependent repositories - 48 downloads last month - 2 stars on GitHub - 1 maintainer
@tokenf/contracts 0.2.0
On-chain Real World Assets Tokenization Framework
3 versions - Latest release: about 2 months ago - 82 downloads last month - 13 stars on GitHub - 1 maintainer
creditcards-tokenizer 1.2.902
Wix Restaurants credit-cards tokenizer
904 versions - Latest release: about 4 years ago - 1 dependent package - 1 dependent repositories - 1.25 thousand downloads last month - 3 stars on GitHub - 10 maintainers
@cybersource/flex-sdk-node 0.1.0
Easily create keys for use in a Flex API integration and verifying Flex token contents
1 version - Latest release: about 6 years ago - 1 dependent package - 1 dependent repositories - 442 downloads last month - 4 maintainers
Top 6.4% on npmjs.org
@cybersource/flex-sdk-web 0.3.1
Easily create payment tokens using Flex API
6 versions - Latest release: about 4 years ago - 3 dependent packages - 1 dependent repositories - 8.88 thousand downloads last month - 19 stars on GitHub - 4 maintainers
@diplodoc/sentenizer 0.0.8
text segmentation into sentences
9 versions - Latest release: 3 months ago - 1 dependent package - 2 dependent repositories - 1.47 thousand downloads last month - 0 stars on GitHub - 9 maintainers
@dev-extralabs/web3 0.2.0
package to deploy the smart contracts that associate the tokens to the various clients proportion...
4 versions - Latest release: 3 months ago - 14 downloads last month - 1 maintainer
@bedrock/tokenization 22.0.0
Bedrock Tokenization Engine
23 versions - Latest release: 3 months ago - 1 dependent package - 1 dependent repositories - 99 downloads last month - 3 stars on GitHub - 5 maintainers
bedrock-tokenization 12.0.0
Bedrock Tokenization Engine
24 versions - Latest release: about 2 years ago - 1 dependent package - 50 downloads last month - 3 stars on GitHub - 5 maintainers
porter-stemmer-js 1.1.2
Very fast Porter Stemmer implementation written in Javascript.
6 versions - Latest release: about 1 month ago - 320 downloads last month - 0 stars on GitHub - 1 maintainer
@polyfact/vectorizer 1.0.5
Here is a README generated from the code snippet:
6 versions - Latest release: 9 months ago - 17 downloads last month - 2 stars on GitHub - 3 maintainers
tiptap-annotation-magic 2.0.0
This is an extension for the [Tiptap](https://github.com/ueberdosis/tiptap) editor (based on Pros...
9 versions - Latest release: 9 months ago - 46 downloads last month - 20 stars on GitHub - 1 maintainer
@steadyx/aether 0.0.21
A JSON parser implemented in TypeScript
15 versions - Latest release: 9 months ago - 10 downloads last month - 1 stars on GitHub - 1 maintainer
@databunker/store 1.0.8
Databunker storage class for nodejs
9 versions - Latest release: about 3 years ago - 1 dependent package - 1 dependent repositories - 15 downloads last month - 2 stars on GitHub - 1 maintainer
lexemic 0.0.8
Tools for working with human language data.
8 versions - Latest release: almost 11 years ago - 1 dependent package - 1 dependent repositories - 13 downloads last month - 7 stars on GitHub - 1 maintainer
Top 5.6% on npmjs.org
nlp-js-tools-french 1.0.9
POS Tagger and lemmatizer for javascript
11 versions - Latest release: about 7 years ago - 3 dependent packages - 16 dependent repositories - 370 downloads last month - 36 stars on GitHub - 1 maintainer
@fat-token/fat-js 1.3.0
Factom Asset Token (FAT) library in JS
16 versions - Latest release: over 4 years ago - 2 dependent packages - 2 dependent repositories - 23 downloads last month - 4 stars on GitHub - 2 maintainers
Top 3.1% on npmjs.org
wink-tokenizer 5.3.0
Multilingual tokenizer that automatically tags each token with its type
19 versions - Latest release: over 2 years ago - 14 dependent packages - 152 dependent repositories - 50.6 thousand downloads last month - 59 stars on GitHub - 3 maintainers
@jwalab/tokenization-service-contracts 0.2.0
Tokenization Service's Smart Contracts
12 versions - Latest release: over 2 years ago - 1 dependent package - 2 dependent repositories - 15 downloads last month - 0 stars on GitHub - 2 maintainers
Top 3.3% on npmjs.org
az 0.2.3
A NLP library for Russian language
9 versions - Latest release: almost 8 years ago - 6 dependent packages - 34 dependent repositories - 2.04 thousand downloads last month - 366 stars on GitHub - 1 maintainer
tinylex 0.7.4
A simple iterative lexer written in TypeScript
21 versions - Latest release: about 5 years ago - 1 dependent package - 1 dependent repositories - 36 downloads last month - 3 stars on GitHub - 1 maintainer
@lunasec/log4shell 1.0.7-beta2 💰
Tools to help remediate the log4shell vulnerability.
2 versions - Latest release: over 2 years ago - 8 downloads last month - 1,408 stars on GitHub - 3 maintainers
rosette-api 1.14.4
Rosette API Node.js client SDK
34 versions - Latest release: almost 4 years ago - 3 dependent repositories - 225 downloads last month - 8 stars on GitHub - 2 maintainers
Top 1.7% on npmjs.org
lex 1.7.9 deprecated 💰
An elegant armor-plated JavaScript lexer modelled after flex. Easily extensible to tailor to your...
21 versions - Latest release: almost 9 years ago - 53 dependent packages - 972 dependent repositories - 96.9 thousand downloads last month - 410 stars on GitHub - 1 maintainer
lexed 1.0.10
English word and sentence tokenizer, for natural language processing.
9 versions - Latest release: about 7 years ago - 5 dependent packages - 9 dependent repositories - 83 downloads last month - 3 stars on GitHub - 1 maintainer
tokenex 0.0.2 removed
TokenEX Node.js library for API
2 versions - Latest release: almost 6 years ago - 1 dependent package - 1 dependent repositories - 12 downloads last month - 1 maintainer
code-vectorizer 1.0.3 unpublished
Code Vectorizer is a tool written in Typescript that helps you vectorize your code. This tool use...
11 versions - Latest release: 10 months ago - 1 dependent repositories - 543 downloads last month - 0 stars on GitHub - 1 maintainer
dropsuit-tok 1.0.9 unpublished
DropSuit NLP - tok function: A JavaScript and Node.js library for tokenizing text
9 versions - Latest release: over 1 year ago - 477 downloads last month - 1 stars on GitHub - 1 maintainer
skyflow-node-dev 1.0.1-beta.3 unpublished
Node js client for skyflow API's
2 versions - Latest release: over 3 years ago - 9 downloads last month - 0 stars on - 1 maintainer