npmjs.org "tokenization" keyword
View the packages on the npmjs.org package registry that are tagged with the "tokenization" keyword.
@tamago-labs/xrpl-mcp 0.1.1
MCP server implementation for XRP Ledger2 versions - Latest release: 8 months ago - 11 downloads last month - 1 stars on GitHub - 1 maintainer
Top 5.3% on npmjs.org
58 versions - Latest release: about 1 year ago - 4 dependent packages - 9 dependent repositories - 1.33 thousand downloads last month - 48 stars on GitHub - 1 maintainer
nlpcloud 2.0.8
NLP Cloud serves high performance pre-trained or custom models for NER, sentiment-analysis, class...58 versions - Latest release: about 1 year ago - 4 dependent packages - 9 dependent repositories - 1.33 thousand downloads last month - 48 stars on GitHub - 1 maintainer
Top 8.7% on npmjs.org
3 versions - Latest release: about 11 years ago - 4 dependent packages - 5 dependent repositories - 82 downloads last month - 241 stars on GitHub - 1 maintainer
salient 0.3.0
Salient is a natural language processing and sentiment analysis library3 versions - Latest release: about 11 years ago - 4 dependent packages - 5 dependent repositories - 82 downloads last month - 241 stars on GitHub - 1 maintainer
sudachi-ts 0.1.9
TypeScript port of Sudachi morphological analyzer for Japanese text7 versions - Latest release: about 20 hours ago - 1 maintainer
@blindfold/cli 1.2.1
CLI for Blindfold PII detection and protection3 versions - Latest release: 1 day ago - 1 maintainer
parsco 0.1.0
A TypeScript library for building powerful, composable parsers using the parser combinator patter...4 versions - Latest release: 6 months ago - 24 downloads last month - 0 stars on GitHub - 1 maintainer
@dev-extralabs/web3 0.2.0
package to deploy the smart contracts that associate the tokens to the various clients proportion...4 versions - Latest release: almost 2 years ago - 5 downloads last month - 1 maintainer
intl-segmenter 1.0.0 💰
A high-performance wrapper around `Intl.Segmenter` for efficient text segmentation. This class re...1 version - Latest release: about 1 year ago - 42 downloads last month - 14 stars on GitHub - 1 maintainer
Top 6.4% on npmjs.org
6 versions - Latest release: almost 6 years ago - 3 dependent packages - 1 dependent repositories - 3.33 thousand downloads last month - 20 stars on GitHub - 4 maintainers
@cybersource/flex-sdk-web 0.3.1
Easily create payment tokens using Flex API6 versions - Latest release: almost 6 years ago - 3 dependent packages - 1 dependent repositories - 3.33 thousand downloads last month - 20 stars on GitHub - 4 maintainers
skyflow-node 2.0.2
Skyflow SDK for Node.js48 versions - Latest release: 3 months ago - 2 dependent repositories - 12.7 thousand downloads last month - 9 stars on GitHub - 1 maintainer
tokenloom 1.0.9
A streaming text parser with custom tag and code fence detection for Node.js9 versions - Latest release: 5 months ago - 71 downloads last month - 1 stars on GitHub - 1 maintainer
Top 5.2% on npmjs.org
15 versions - Latest release: about 5 years ago - 4 dependent packages - 4 dependent repositories - 4.21 thousand downloads last month - 40 stars on GitHub - 1 maintainer
html-tokenizer 4.0.1
Small, fast, event-driven, fault-tolerant html tokenizer. Works in node or browsers.15 versions - Latest release: about 5 years ago - 4 dependent packages - 4 dependent repositories - 4.21 thousand downloads last month - 40 stars on GitHub - 1 maintainer
blingfire 0.1.1
Node.js bindings for BlingFire tokenization library2 versions - Latest release: 3 months ago - 1 maintainer
vgscli 0.0.2
A command-line tool for managing VGS aliases for tokenization2 versions - Latest release: 4 months ago - 8 downloads last month - 1 maintainer
dapp-sdk-js 1.0.0
Official TypeScript/JavaScript SDK for DAPP AI Cost Platform1 version - Latest release: 3 months ago - 1 maintainer
@fwcgovau/fat-zebra-nextjs 0.5.9
Fat Zebra payment processing library for Next.js and standalone environments3 versions - Latest release: 7 months ago - 7 downloads last month - 1 stars on GitHub - 1 maintainer
niubiz-pay 0.1.2
Library that allows you to make payments and tokenize debit and credit cards with Niubiz.17 versions - Latest release: 8 months ago - 10 downloads last month - 1 stars on GitHub - 1 maintainer
@santerijps/tokenizer 1.0.3
A simple generic string tokenizer4 versions - Latest release: almost 2 years ago - 3 downloads last month - 0 stars on GitHub - 1 maintainer
@tokeflow_com/bridge-js 2.0.1
Secure payment tokenization SDK by Tokeflow3 versions - Latest release: 13 days ago - 150 downloads last month
@chonkiejs/chunk 0.9.3
The fastest semantic text chunking library8 versions - Latest release: 22 days ago
@blindfold/sdk 1.0.0
JavaScript/TypeScript SDK for Blindfold Gateway1 version - Latest release: 23 days ago
fr3kn3xus 2.0.0
🌌 FR3K NEXUS v2.0 - Advanced Quantum Trading Platform with AI Agents, Neural Interface, Cosmic Ti...2 versions - Latest release: 3 months ago - 1 maintainer
@jwalab/tokenization-service-contracts 0.2.0
Tokenization Service's Smart Contracts12 versions - Latest release: about 4 years ago - 1 dependent package - 2 dependent repositories - 316 downloads last month - 0 stars on GitHub - 2 maintainers
lexemic 0.0.8
Tools for working with human language data.8 versions - Latest release: over 12 years ago - 1 dependent package - 1 dependent repositories - 15 downloads last month - 7 stars on GitHub - 1 maintainer
Top 3.3% on npmjs.org
9 versions - Latest release: over 9 years ago - 6 dependent packages - 34 dependent repositories - 3.8 thousand downloads last month - 366 stars on GitHub - 1 maintainer
az 0.2.3
A NLP library for Russian language9 versions - Latest release: over 9 years ago - 6 dependent packages - 34 dependent repositories - 3.8 thousand downloads last month - 366 stars on GitHub - 1 maintainer
sentence-tools 4.0.0
Tools for manipulating sentences8 versions - Latest release: over 6 years ago - 2 dependent packages - 7 dependent repositories - 114 downloads last month - 8 stars on GitHub - 1 maintainer
emon-js 0.1.0
A compact, schema-driven, and token-optimal data format for LLM and Microservice communication.1 version - Latest release: about 2 months ago - 1 maintainer
@diplodoc/sentenizer 0.0.9
text segmentation into sentences10 versions - Latest release: about 1 month ago - 1 dependent package - 2 dependent repositories - 4.36 thousand downloads last month - 0 stars on GitHub - 8 maintainers
bedrock-tokenizer 6.0.0
A Bedrock module to provide auto-rotating tokenizers10 versions - Latest release: almost 4 years ago - 1 dependent package - 13 downloads last month - 0 stars on GitHub - 5 maintainers
Top 8.4% on npmjs.org
1 version - Latest release: over 3 years ago - 2 dependent packages - 4 dependent repositories - 94 downloads last month - 5 stars on GitHub - 7 maintainers
@doc-tools/sentenizer 0.0.0
text segmentation into sentences1 version - Latest release: over 3 years ago - 2 dependent packages - 4 dependent repositories - 94 downloads last month - 5 stars on GitHub - 7 maintainers
easters-crypto 1.1.0
Modular backend service for tokenization and smart contracts in real estate applications2 versions - Latest release: 11 months ago - 5 downloads last month - 1 maintainer
tokenize-words 0.0.4-alpha.0
Break down text into array of words.4 versions - Latest release: over 2 years ago - 4 dependent packages - 28 downloads last month - 0 stars on GitHub - 1 maintainer
@clipperhouse/jargon 0.3.0
A tokenizer and lemmatizer for canonical terms in text13 versions - Latest release: almost 2 years ago - 1 dependent package - 1 dependent repositories - 19 downloads last month - 2 stars on GitHub - 1 maintainer
salient_for_meteor 0.2.1
Salient is a natural language processing and sentiment analysis library2 versions - Latest release: over 10 years ago - 15 downloads last month - 241 stars on GitHub - 1 maintainer
@deonpay/elements-sdk 0.1.0
DeonPay Elements SDK - Embeddable payment UI components with multi-acquirer routing1 version - Latest release: 3 months ago - 5 downloads last month - 1 maintainer
sdk-pocs 0.2.0
2 versions - Latest release: over 1 year ago - 2 downloads last month - 1 maintainernodewordfreq 0.2.1
TypeScript/Node.js 版 wordfreq，内置词频数据与中文分词词典，开箱即用的跨语言词频查询与 Zipf/分词能力。4 versions - Latest release: about 2 months ago - 287 downloads last month - 1 maintainer
tiptap-annotation-magic 2.0.0
This is an extension for the [Tiptap](https://github.com/ueberdosis/tiptap) editor (based on Pros...9 versions - Latest release: over 2 years ago - 319 downloads last month - 35 stars on GitHub - 1 maintainer
@basd/search 0.0.5
A powerful and flexible text search library for JavaScript that enables you to build a simple tex...5 versions - Latest release: about 2 years ago - 1 dependent package - 10 downloads last month - 0 stars on GitHub - 1 maintainer
eddo-rwa 1.0.0
OpenZeppelin-style smart contract library for Real World Assets with configurable rules engine1 version - Latest release: 27 days ago - 93 downloads last month
@lanonasis/privacy-sdk 1.0.0
Enterprise-grade privacy utilities: PII detection, data masking, tokenization, and GDPR complianc...1 version - Latest release: 26 days ago
shekar-js 0.1.0
A TypeScript/JavaScript Toolkit for Persian NLP1 version - Latest release: 5 months ago - 4 downloads last month - 1 maintainer
@nlptools/nlptools 0.0.2
Main NLPTools package - Complete suite of NLP algorithms, text distance, similarity, splitting, a...16 versions - Latest release: 3 months ago - 7 downloads last month - 0 stars on GitHub - 1 maintainer
@tuna-software/react-native-sdk 1.4.0
React Native payment processing SDK for Tuna with native Apple Pay and Google Pay support4 versions - Latest release: 4 months ago - 15 downloads last month - 0 stars on GitHub - 2 maintainers
dips.js 0.0.2
Multi-criteria Cantonese segmentation with dashes, intermediates, pipes, and spaces.2 versions - Latest release: over 1 year ago - 13 downloads last month - 0 stars on GitHub - 1 maintainer
rwa-build 0.1.0
MCP library for AI-assisted Real World Asset tokenization on XRPL1 version - Latest release: 8 months ago - 2 downloads last month - 0 stars on GitHub - 1 maintainer
ogden 1.0.6 💰
Basic English tokenizer7 versions - Latest release: over 9 years ago - 1 dependent package - 1 dependent repositories - 9 downloads last month - 1 stars on GitHub - 1 maintainer
@deskcreate/cybersource-3ds-web 1.0.4
CyberSource 3DS Web SDK for browser-based integrations with Flex Microform support4 versions - Latest release: 22 days ago - 402 downloads last month
smartcal 1.0.14
A powerful, lightweight TypeScript library for dynamic mathematical expression evaluation with su...15 versions - Latest release: 4 months ago - 39 downloads last month - 0 stars on GitHub - 1 maintainer
@the-horizon-dev/fast-tokenizer 1.5.0
High-performance library for tokenizing text.16 versions - Latest release: 5 months ago - 97 downloads last month - 0 stars on GitHub - 1 maintainer
arajs 1.0.13
An npm module that provides Arabic language processing capabilities for JavaScript applications, ...14 versions - Latest release: almost 3 years ago - 1 dependent package - 236 downloads last month - 7 stars on GitHub - 1 maintainer
@moveyourdigital/nlp 0.1.4
NLP (natural language processing) for server and the browser in TypeScript. All lightweight and s...5 versions - Latest release: over 1 year ago - 2 downloads last month - 1 stars on GitHub - 1 maintainer
@ason-format/ason 1.1.4
ASON (Aliased Serialization Object Notation) - Token-optimized JSON compression for LLMs. Reduces...7 versions - Latest release: 3 months ago - 623 downloads last month - 0 stars on GitHub - 1 maintainer
@basis-theory/google-pay-js 1.0.0
Basis Theory utility for decrypting Google Pay Tokens1 version - Latest release: almost 2 years ago - 4.87 thousand downloads last month - 2 stars on GitHub - 10 maintainers
javascript-recognize 1.3.2
6 versions - Latest release: about 6 years ago - 1 dependent package - 1 dependent repositories - 13 downloads last month - 0 stars on GitHub - 1 maintainerharmony-protocol-js 0.1.0
Node.js implementation of OpenAI's Harmony response format for structured conversational AI inter...1 version - Latest release: 5 months ago - 6 downloads last month - 1 maintainer
@fat-token/fat-js 1.3.0
Factom Asset Token (FAT) library in JS16 versions - Latest release: over 6 years ago - 2 dependent packages - 2 dependent repositories - 32 downloads last month - 4 stars on GitHub - 2 maintainers
@goon-format/cli 1.0.4
CLI for GOON (Greatly Optimized Object Notation) - Convert JSON to ultra-compact GOON format5 versions - Latest release: 2 months ago - 1 maintainer
hron-format 1.2.1
HRON (Hierarchical Reference Object Notation) is a structured text format focused on being readab...11 versions - Latest release: 2 months ago - 76 downloads last month - 1 maintainer
@hashgraph/asset-tokenization-contracts 3.1.0
<div align="center">22 versions - Latest release: 22 days ago - 482 downloads last month - 15 maintainers
@astropay/tokenizer-sdk 1.1.3
Official AstroPay client for easy frontend integration to Tokenizer2 versions - Latest release: about 1 year ago - 279 downloads last month - 1 maintainer
ff3 1.0.1
NIST standard Format-preserving encryption FF3-1 implementation5 versions - Latest release: over 3 years ago - 1 dependent package - 1 dependent repositories - 22 thousand downloads last month - 33 stars on GitHub - 1 maintainer
lexr 1.0.4
Lexical analyzer built in Javascript26 versions - Latest release: over 7 years ago - 1 dependent package - 2 dependent repositories - 109 downloads last month - 16 stars on GitHub - 1 maintainer
rosette-api 1.31.0
Babel Street Analytics API Node.js client SDK35 versions - Latest release: about 1 year ago - 3 dependent repositories - 271 downloads last month - 8 stars on GitHub - 2 maintainers
rwa-tokenized-sdk 0.1.1
Complete SDK for RWA (Real World Assets) tokenization, payments, subscriptions, and access contro...2 versions - Latest release: about 1 month ago - 174 downloads last month
tasknization 1.0.3
Define a function to execute after completing token-defined tasks.2 versions - Latest release: over 6 years ago - 1 dependent repositories - 13 downloads last month - 1 stars on GitHub - 1 maintainer
memchunk 0.4.0
The fastest semantic text chunking library10 versions - Latest release: about 1 month ago - 747 downloads last month - 2 stars on GitHub - 1 maintainer
n8n-nodes-brickken-api 1.0.12
n8n community node for Brickken API V2 - tokenization and STO operations on blockchain11 versions - Latest release: 2 months ago - 993 downloads last month - 3 maintainers
@bedrock/tokenization 23.1.0
Bedrock Tokenization Engine29 versions - Latest release: 9 months ago - 1 dependent package - 1 dependent repositories - 34 downloads last month - 3 stars on GitHub - 4 maintainers
jexer 0.2.0
a lexer in javascript1 version - Latest release: almost 7 years ago - 1 dependent package - 1 dependent repositories - 8 downloads last month - 0 stars on GitHub - 1 maintainer
tokenize-sync 2.0.0 💰
Simple synchronous string tokenizer using Regex2 versions - Latest release: about 8 years ago - 3 dependent packages - 2 dependent repositories - 15 downloads last month - 1 stars on GitHub - 1 maintainer
vscode-textmate-languageservice 5.0.0
Textmate token-based language service for Visual Studio Code.27 versions - Latest release: about 2 months ago - 1 dependent repositories - 191 downloads last month - 22 stars on GitHub - 1 maintainer
@portous/payment-sdk 2.1.1
Official Node.js SDK for Portous Payment Platform - Accept payments, manage tokens, and handle tr...10 versions - Latest release: 4 months ago - 631 downloads last month - 1 maintainer
bedrock-tokenization 12.0.0
Bedrock Tokenization Engine24 versions - Latest release: almost 4 years ago - 1 dependent package - 6 downloads last month - 3 stars on GitHub - 5 maintainers
@bbreukelen/textsplitter 1.2.0
#### Description I needed the SentenceSplitter from llamaindex but had to import the entire llama...4 versions - Latest release: about 1 year ago - 19 downloads last month - 1 maintainer
llm-distillery 1.4.0
Use LLMs to run map-reduce summarization tasks on large documents until a target token size is met.14 versions - Latest release: 4 months ago - 22 downloads last month - 3 stars on GitHub - 1 maintainer
tokenizing 0.1.0
tokenizing text by rules1 version - Latest release: over 1 year ago - 31 downloads last month - 1 maintainer
pruf-js 0.5.2
An interface to the pruf network written in javascript41 versions - Latest release: over 3 years ago - 1 dependent package - 335 downloads last month - 0 stars on GitHub - 1 maintainer
@wowool/portal 1.1.7
A library for natural language processing tasks including tokenization, entity recognition, anony...25 versions - Latest release: 4 months ago - 243 downloads last month - 1 maintainer
adebiet 0.0.1
Adebiet1 version - Latest release: over 1 year ago - 16 downloads last month - 1 maintainer
openvino-tokenizers-node 2025.4.0
OpenVINO™ Tokenizers adds text processing operations to openvino-node package6 versions - Latest release: 2 months ago - 58 downloads last month - 42 stars on GitHub - 1 maintainer
@vishnu-vashishth/llm-sdk 1.2.0
A standalone, type-safe LLM SDK with multi-provider support, retry logic, context management, and...2 versions - Latest release: 2 months ago - 1 maintainer
@goon-format/goon 1.0.4
Greatly Optimized Object Notation - Hyper-compact LLM-friendly data format5 versions - Latest release: 2 months ago - 45 downloads last month - 1 maintainer
Top 7.1% on npmjs.org
5 versions - Latest release: almost 3 years ago - 2 dependent packages - 7 dependent repositories - 2.91 thousand downloads last month - 11 stars on GitHub - 1 maintainer
gpt-token-utils 1.2.0
Isomorphic utilities for GPT-3 tokenization and prompt building.5 versions - Latest release: almost 3 years ago - 2 dependent packages - 7 dependent repositories - 2.91 thousand downloads last month - 11 stars on GitHub - 1 maintainer
@mashub/sdk 1.0.1
Official SDK for MAS Hub - Enterprise blockchain platform built on MasChain2 versions - Latest release: 8 months ago - 6 downloads last month - 1 maintainer
charabia-js 0.2.0 💰
A WebAssembly binding for the charabia multilingual text tokenizer used by Meilisearch.2 versions - Latest release: about 1 year ago - 58 downloads last month - 1 stars on GitHub - 1 maintainer
n8n-nodes-skyflow 0.1.1
n8n node for Skyflow data privacy operations including detokenization2 versions - Latest release: 2 months ago - 22 downloads last month - 1 maintainer
lunasec-cli 0.0.1-alpha.14
a wrapper around the LunaSec CLI enabling it to be used as an NPM package1 version - Latest release: over 4 years ago - 1 dependent package - 2 downloads last month - 1 maintainer
@toon-format/cli 2.1.0
CLI for JSON ↔ TOON conversion using @toon-format/toon15 versions - Latest release: 2 months ago - 1.04 thousand downloads last month - 8,063 stars on GitHub - 1 maintainer
defarm-sdk 3.0.3
DeFarm SDK - Git for traceability with multi-role permissions and global item discovery for agric...52 versions - Latest release: 6 months ago - 229 downloads last month - 1 maintainer
taibun 1.1.3
Taiwanese Hokkien Transliterator and Tokeniser11 versions - Latest release: over 1 year ago - 26 downloads last month - 3 stars on GitHub - 1 maintainer
@polyfact/vectorizer 1.0.5
Here is a README generated from the code snippet:6 versions - Latest release: over 2 years ago - 16 downloads last month - 2 stars on GitHub - 3 maintainers
pos-tokenizer 1.0.0
POS tokenization of words int meaningful components usable in POS-Bayes & Elastic Search Indexes1 version - Latest release: over 10 years ago - 1 dependent package - 1 dependent repositories - 9 downloads last month - 2 stars on GitHub - 1 maintainer
motuma-form 1.0.0
This template provides a minimal setup to get React working in Vite with HMR and some ESLint rules.1 version - Latest release: 12 months ago - 4 downloads last month - 1 maintainer
@toon-format/toon 2.1.0
Token-Oriented Object Notation (TOON) – Compact, human-readable, schema-aware encoding of JSON fo...15 versions - Latest release: 2 months ago - 105 thousand downloads last month - 8,063 stars on GitHub - 1 maintainer
brainnet-tokenizer 1.0.0
A simple and efficient tokenizer for natural language processing tasks.1 version - Latest release: about 1 year ago - 4 downloads last month - 1 maintainer
lex-es6 1.1.0 💰
es6 version of aaditmshah/lexer4 versions - Latest release: over 10 years ago - 2 dependent packages - 1 dependent repositories - 64 downloads last month - 0 stars on GitHub - 1 maintainer
@hubeet-ai/anon-infer-proxy 1.0.3
A secure proxy library for anonymizing sensitive tokens in inference requests to external LLM ser...2 versions - Latest release: 5 months ago - 6 downloads last month - 0 stars on GitHub - 1 maintainer
tokenex 0.0.2
TokenEX Node.js library for API2 versions - Latest release: over 7 years ago - 1 dependent package - 1 dependent repositories - 29 downloads last month - 1 maintainer
Related Keywords
tokenizer
36
nlp
33
llm
22
typescript
20
javascript
16
security
15
blockchain
15
token
14
ai
14
text-processing
13
payment
12
serialization
11
parser
11
natural-language-processing
10
json
10
openai
9
nodejs
9
data-format
9
payments
9
tokenize
9
privacy
9
ethereum
8
sdk
8
rwa
8
chunking
7
lexer
7
smart-contracts
7
machine-learning
7
defi
7
web3
7
api
7
real-world-assets
7
flex
7
natural language processing
7
encryption
6
anonymization
6
bedrock
6
compression
6
gpt
6
react
6
pci
6
transliteration
5
compliance
5
cybersource
5
text
5
NLP
5
anthropic
5
text processing
5
syntax
5
credit-card
5
lex
5
gdpr
5
natural
5
processing
5
language
5
node
5
cli
5
pii
5
categorization
4
speech
4
transliterator
4
romanization
4
js
4
hokkien
4
taigi
4
segmentation
4
taiwanese
4
wasm
4
taiwan
4
words
4
claude
4
text-analysis
4
n8n-community-node-package
4
tokens
4
tokenex
4
crypto
4
chatbot
4
lemmatization
4
parsing
4
toon
4
scanning
4
lexical
4
regex
3
dimensionality-reduction
3
sentence
3
language-processing
3
normalization
3
artificial-intelligence
3
npm
3
payment-gateway
3
information-retrieval
3
tiktoken
3
proxy
3
deep-learning
3
skyflow
3
vault
3
stemming
3
streaming
3
text-mining
3
solidity
3