An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

npmjs.org "tokenizer" keyword

Top 1.3% on npmjs.org
stream-json 3.8.0 πŸ’°
A micro-library of stream components for building custom JSON and JSONC processing pipelines with...
58 versions - Latest release: 1 day ago - 256 dependent packages - 5,960 dependent repositories - 43.2 million downloads last month - 1,205 stars on GitHub - 1 maintainer
@thasmorato/stream-json 2.1.3 πŸ’°
stream-json is the micro-library of Node.js stream components for creating custom JSON processing...
6 versions - Latest release: over 1 year ago - 11 downloads last month - 1,205 stars on GitHub - 1 maintainer
@depup/stream-json 3.7.0-depup.0 πŸ’°
A micro-library of stream components for building custom JSON and JSONC processing pipelines with...
7 versions - Latest release: about 1 month ago - 57 downloads last month - 1,205 stars on GitHub - 1 maintainer
@yahyeapps/stream-json 3.3.2 πŸ’°
A micro-library of stream components for building custom JSON and JSONC processing pipelines with...
2 versions - Latest release: 3 months ago - 351 downloads last month - 1,205 stars on GitHub - 1 maintainer
stream-json-ak 1.7.511 πŸ’°
fork of stream-json
3 versions - Latest release: over 3 years ago - 8 downloads last month - 1,205 stars on GitHub - 1 maintainer
Top 0.7% on npmjs.org
jison 0.4.18
A parser generator with Bison's API
51 versions - Latest release: about 9 years ago - 829 dependent packages - 34,659 dependent repositories - 334 thousand downloads last month - 4,380 stars on GitHub - 1 maintainer
tokenizers-wasm 1.0.0-rc.3 deprecated
WebAssembly bindings to the Hugging Face tokenizers library, for fast tokenization in the browser.
2 versions - Latest release: 11 days ago - 4 dependent packages - 1 dependent repositories - 201 downloads last month - 11,204 stars on GitHub - 2 maintainers
Top 9.2% on npmjs.org
happynodetokenizer 7.1.0 πŸ’°
A simple, Twitter-aware tokenizer.
29 versions - Latest release: over 2 years ago - 11 dependent packages - 26 dependent repositories - 91 downloads last month - 5 stars on GitHub - 1 maintainer
@lpi/react-bootstrap-typeahead 4.0.0-alpha.10
React typeahead with Bootstrap styling
1 version - Latest release: almost 7 years ago - 1 dependent package - 1 dependent repositories - 37 downloads last month - 1,006 stars on GitHub - 2 maintainers
@mrizki/natural 0.6.4-build1
General natural language (tokenizing, stemming (English, Russian, Spanish), part-of-speech taggin...
1 version - Latest release: almost 7 years ago - 1 dependent package - 3 dependent repositories - 42 downloads last month - 10,884 stars on GitHub - 1 maintainer
Top 0.6% on npmjs.org
natural 8.2.6
General natural language (tokenizing, stemming (English, Russian, Spanish), part-of-speech taggin...
154 versions - Latest release: 4 days ago - 499 dependent packages - 24,309 dependent repositories - 5.22 million downloads last month - 10,884 stars on GitHub - 3 maintainers
tacnoman-scss-tokenizer 0.3.1
A tokenzier for Sass' SCSS syntax
2 versions - Latest release: over 8 years ago - 2 dependent packages - 1 dependent repositories - 7 downloads last month - 25 stars on GitHub - 1 maintainer
Top 1.0% on npmjs.org
glsl-token-whitespace-trim 1.0.0
Trim the whitespace within an array of GLSL tokens
1 version - Latest release: almost 11 years ago - 6 dependent packages - 7,486 dependent repositories - 2.93 million downloads last month - 16 maintainers
cattown 1.1.1 unpublished
A lightweight, pure JavaScript markdown parser with built-in HTML sanitization using DOMPurify. C...
5 versions - Latest release: about 1 year ago - 73 downloads last month - 0 stars on GitHub - 1 maintainer
react-bootstrap-typeahead-ie11-compatible 1.3.0
React-based typeahead using the Bootstrap theme
1 version - Latest release: over 9 years ago - 1 dependent package - 1 dependent repositories - 23 downloads last month - 1,006 stars on GitHub - 1 maintainer
@tkloht/react-bootstrap-typeahead 1.3.0
React-based typeahead using the Bootstrap theme
1 version - Latest release: over 9 years ago - 2 dependent packages - 1 dependent repositories - 38 downloads last month - 1,006 stars on GitHub - 1 maintainer
react-bootstrap-typeahead-ali 1.0.2
React-based typeahead using the Bootstrap theme by react-bootstrap-typeahead v1.0.0-beta5
3 versions - Latest release: over 9 years ago - 1 dependent package - 1 dependent repositories - 46 downloads last month - 1,006 stars on GitHub - 1 maintainer
sppro-react-bootstrap-typeahead 5.1.8
React typeahead with Bootstrap styling Forked By SharePointPro
4 versions - Latest release: over 5 years ago - 87 downloads last month - 1,006 stars on GitHub - 1 maintainer
react-bootstrap-typeahead-with-restart 1.0.0
React typeahead with Bootstrap styling
1 version - Latest release: almost 3 years ago - 63 downloads last month - 1,006 stars on GitHub - 1 maintainer
Top 0.9% on npmjs.org
react-bootstrap-typeahead 6.4.1
React typeahead with Bootstrap styling
182 versions - Latest release: over 1 year ago - 226 dependent packages - 2,098 dependent repositories - 719 thousand downloads last month - 1,006 stars on GitHub - 1 maintainer
Top 2.3% on npmjs.org
scss-tokenizer 0.4.3
A tokenzier for Sass' SCSS syntax
13 versions - Latest release: about 4 years ago - 66 dependent packages - 998,711 dependent repositories - 4.17 million downloads last month - 25 stars on GitHub - 1 maintainer
Top 3.5% on npmjs.org
graphql-query-compress 1.2.4 πŸ’°
Compress a GraphQL Query String
31 versions - Latest release: over 6 years ago - 35 dependent packages - 271 dependent repositories - 50.4 thousand downloads last month - 38 stars on GitHub - 1 maintainer
Top 2.1% on npmjs.org
gpt3-tokenizer 1.1.5 πŸ’°
[![Build](https://github.com/botisan-ai/gpt3-tokenizer/actions/workflows/main.yml/badge.svg)](htt...
9 versions - Latest release: almost 4 years ago - 53 dependent packages - 983 dependent repositories - 120 thousand downloads last month - 171 stars on GitHub - 1 maintainer
Top 2.4% on npmjs.org
strtok3 10.6.3 πŸ’°
A promise based streaming tokenizer
126 versions - Latest release: 4 days ago - 56 dependent packages - 70,737 dependent repositories - 141 million downloads last month - 51 stars on GitHub - 1 maintainer
Top 2.4% on npmjs.org
glsl-tokenizer 2.1.5
r/w stream of glsl tokens
22 versions - Latest release: about 8 years ago - 84 dependent packages - 9,210 dependent repositories - 2.63 million downloads last month - 52 stars on GitHub - 16 maintainers
Top 4.2% on npmjs.org
glsl-token-inject-block 1.1.0
safely inject a block of tokens into a shader
2 versions - Latest release: over 10 years ago - 5 dependent packages - 7,586 dependent repositories - 4.56 million downloads last month - 5 stars on GitHub - 1 maintainer
glsl-token-extract-version 1.0.1
finds a #version field in a set of GLSL tokens
2 versions - Latest release: over 11 years ago - 1 dependent package - 1 dependent repositories - 10 downloads last month - 3 stars on GitHub - 1 maintainer
Top 5.3% on npmjs.org
glob-parse 0.0.1
Returns a parsed representation of a glob string; does not require Minimatch.
1 version - Latest release: over 12 years ago - 4 dependent packages - 63 dependent repositories - 7.55 thousand downloads last month - 5 stars on GitHub - 1 maintainer
@alexssmusica/strtok3 7.0.1 πŸ’°
A promise based streaming tokenizer
1 version - Latest release: over 3 years ago - 2 dependent packages - 21 downloads last month - 51 stars on GitHub - 1 maintainer
Top 1.3% on npmjs.org
js-tokens 10.0.0
Tiny JavaScript tokenizer.
25 versions - Latest release: 11 months ago - 2,251 dependent packages - 1,940,799 dependent repositories - 858 million downloads last month - 555 stars on GitHub - 1 maintainer
Top 2.4% on npmjs.org
gpt-tokenizer 4.1.0 πŸ’°
A pure JavaScript BPE tokenizer with model metadata and pricing for GPT-5, GPT-4o, o-series, and ...
40 versions - Latest release: 12 days ago - 36 dependent packages - 22 dependent repositories - 7.78 million downloads last month - 856 stars on GitHub - 1 maintainer
@caoer/strtok3 7.0.3 πŸ’°
A promise based streaming tokenizer
2 versions - Latest release: almost 4 years ago - 2 dependent packages - 18 downloads last month - 51 stars on GitHub - 1 maintainer
unbash 6.0.2
The best bash parser in JavaScript. Fast, complete, typed.
25 versions - Latest release: about 8 hours ago - 61.1 million downloads last month - 139 stars on GitHub - 1 maintainer
Top 4.7% on npmjs.org
leac 0.7.0 πŸ’°
Lexer / tokenizer
5 versions - Latest release: about 1 year ago - 4 dependent packages - 4,330 dependent repositories - 72.4 million downloads last month - 13 stars on GitHub - 1 maintainer
@tokenizer/inflate 0.6.0 πŸ’°
Tokenized zip support
15 versions - Latest release: 6 days ago - 116 million downloads last month - 0 stars on GitHub - 1 maintainer
@ohos-npm-ports/yuku-parser 0.10.2-1
High-performance JavaScript/TypeScript parser
7 versions - Latest release: about 1 month ago - 1.11 thousand downloads last month - 7 stars on GitHub - 1 maintainer
Top 3.7% on npmjs.org
parenthesis 3.1.8 πŸ’°
Parse parentheses from a string
19 versions - Latest release: almost 5 years ago - 48 dependent packages - 4,567 dependent repositories - 4.39 million downloads last month - 5 stars on GitHub - 2 maintainers
Top 6.4% on npmjs.org
is-html-attribute-closing 4.2.6
Is a character on a given index a closing of an HTML attribute?
97 versions - Latest release: about 1 month ago - 2 dependent packages - 7 dependent repositories - 2.93 thousand downloads last month - 214 stars on GitHub - 1 maintainer
@papit/lexer 0.0.2
Character-level state machine lexer: describe states and rules, get a token list back. Ships read...
2 versions - Latest release: about 13 hours ago - 201 downloads last month - 1 stars on GitHub - 1 maintainer
foldmaker 1.0.5
A small parser generator toolkit that can be used to build parsers, transpilers, formatters.
5 versions - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 31 downloads last month - 1 stars on GitHub - 1 maintainer
css-tree-nup 3.0.1 unpublished πŸ’°
A tool set for CSS: fast detailed parser (CSS β†’ AST), walker (AST traversal), generator (AST β†’ CS...
1 version - Latest release: about 2 years ago - 68 downloads last month - 2,123 stars on GitHub - 1 maintainer
flukejs 0.0.11
tokenizer, lexer
12 versions - Latest release: over 8 years ago - 2 dependent packages - 3 dependent repositories - 27 downloads last month - 1 stars on GitHub - 1 maintainer
Top 1.8% on npmjs.org
@chevrotain/gast 13.2.0
Grammar AST structure for Chevrotain Parsers
21 versions - Latest release: 3 months ago - 3 dependent packages - 6,744 dependent repositories - 38.6 million downloads last month - 2,814 stars on GitHub - 1 maintainer
@depup/css-tree 3.2.1-depup.10 πŸ’°
A tool set for CSS: fast detailed parser (CSS β†’ AST), walker (AST traversal), generator (AST β†’ CS...
10 versions - Latest release: about 1 month ago - 113 downloads last month - 2,128 stars on GitHub - 1 maintainer
Top 1.6% on npmjs.org
@chevrotain/utils 13.2.0
common utilities
25 versions - Latest release: 3 months ago - 4 dependent packages - 7,794 dependent repositories - 38.8 million downloads last month - 2,814 stars on GitHub - 1 maintainer
Top 2.3% on npmjs.org
@chevrotain/cst-dts-gen 13.2.0
Generates type definitions for Chevrotain CST nodes
23 versions - Latest release: 3 months ago - 2 dependent packages - 6,533 dependent repositories - 37.8 million downloads last month - 2,814 stars on GitHub - 1 maintainer
Top 0.9% on npmjs.org
css-tree 3.2.1 πŸ’°
A tool set for CSS: fast detailed parser (CSS β†’ AST), walker (AST traversal), generator (AST β†’ CS...
60 versions - Latest release: 8 months ago - 820 dependent packages - 2,569,508 dependent repositories - 500 million downloads last month - 2,128 stars on GitHub - 2 maintainers
aiot-css-tree 2.3.1 πŸ’°
A tool set for CSS: fast detailed parser (CSS β†’ AST), walker (AST traversal), generator (AST β†’ CS...
2 versions - Latest release: about 2 years ago - 2.6 thousand downloads last month - 2,128 stars on GitHub - 1 maintainer
@chevrotain/regexp-to-ast 13.2.0
Parses a Regular Expression and outputs an AST
12 versions - Latest release: 3 months ago - 1 dependent repositories - 28.8 million downloads last month - 2,814 stars on GitHub - 1 maintainer
Top 1.2% on npmjs.org
@chevrotain/types 13.2.0
Type Signatures and API Website for Chevrotain
26 versions - Latest release: 3 months ago - 13 dependent packages - 7,797 dependent repositories - 84.1 million downloads last month - 2,814 stars on GitHub - 1 maintainer
Top 0.8% on npmjs.org
chevrotain 13.2.0
Chevrotain is a high performance fault tolerant javascript parsing DSL for building recursive dec...
175 versions - Latest release: 3 months ago - 282 dependent packages - 17,129 dependent repositories - 43.6 million downloads last month - 2,813 stars on GitHub - 1 maintainer
css-tree-v2 1.1.3-beta01 πŸ’°
ε°†mdn-dataη”±2.0.14ε‡ηΊ§εˆ°2.0.23
2 versions - Latest release: 10 months ago - 10 downloads last month - 2,127 stars on GitHub - 1 maintainer
Top 3.9% on npmjs.org
flex-js 2.0.0
FLEX for JavaScript and TypeScript: the fast lexical analyser generator, emitting scanners with n...
11 versions - Latest release: about 2 months ago - 10 dependent packages - 15 dependent repositories - 4.53 thousand downloads last month - 45 stars on GitHub - 1 maintainer
Top 1.0% on npmjs.org
micromark 4.0.3 πŸ’°
small commonmark compliant markdown parser with positional info and concrete tokens
43 versions - Latest release: about 1 month ago - 144 dependent packages - 151,327 dependent repositories - 241 million downloads last month - 2,236 stars on GitHub - 1 maintainer
@depup/micromark 4.0.3-depup.0 πŸ’°
small commonmark compliant markdown parser with positional info and concrete tokens (with updated...
2 versions - Latest release: about 1 month ago - 43 downloads last month - 2,236 stars on GitHub - 1 maintainer
parse5-wxmp 3.0.3 πŸ’°
HTML parsing/serialization toolset for Node.js. WHATWG HTML Living Standard (aka HTML5)-compliant.
1 version - Latest release: about 9 years ago - 2 dependent packages - 1 dependent repositories - 16 downloads last month - 3,938 stars on GitHub - 1 maintainer
Top 7.9% on npmjs.org
extract-lemmatized-nonstop-words 1.0.19
Extracts a pure list of lemmatized words of a text filtered by stop words
17 versions - Latest release: over 7 years ago - 3 dependent packages - 8 dependent repositories - 137 downloads last month - 5 stars on GitHub - 1 maintainer
Top 7.7% on npmjs.org
complexion-js 0.2.2
Tokenize JavaScript
9 versions - Latest release: over 5 years ago - 2 dependent packages - 42 dependent repositories - 7.13 thousand downloads last month - 2 stars on GitHub - 1 maintainer
Top 7.6% on npmjs.org
expression-engine 1.11.1
An expression tokenizer, parser and evaluator.
27 versions - Latest release: almost 3 years ago - 5 dependent packages - 2 dependent repositories - 485 downloads last month - 8 stars on GitHub - 1 maintainer
Top 1.5% on npmjs.org
talisman 1.1.4 πŸ’°
Straightforward fuzzy matching, information retrieval and NLP building blocks for JavaScript.
30 versions - Latest release: almost 6 years ago - 48 dependent packages - 20,812 dependent repositories - 269 thousand downloads last month - 732 stars on GitHub - 1 maintainer
Top 1.4% on npmjs.org
@csstools/css-tokenizer 4.0.2 πŸ’°
Tokenize CSS
25 versions - Latest release: about 1 month ago - 30 dependent packages - 10,014 dependent repositories - 337 million downloads last month - 1,059 stars on GitHub - 3 maintainers
llama3-tokenizer-js 1.2.0
JS tokenizer for LLaMA 3
9 versions - Latest release: about 2 years ago - 20.1 thousand downloads last month - 119 stars on GitHub - 1 maintainer
scbe-aethermoore-cli 4.4.0 πŸ’°
Standalone CLI for SCBE-AETHERMOORE: natural-language command resolver with autocorrect ledger, G...
14 versions - Latest release: 5 months ago - 20 downloads last month - 7 stars on GitHub - 1 maintainer
escuelle 0.0.11
SQL tokeniser & parser
11 versions - Latest release: almost 8 years ago - 2 dependent packages - 2 dependent repositories - 18 downloads last month - 3 stars on GitHub - 1 maintainer
@lenml/tokenizer-text_embedding_ada002 3.7.2
text_embedding_ada002 tokenizer for NodeJS/Browser
13 versions - Latest release: about 1 year ago - 33 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-qwen1_5 3.7.2
qwen1_5 tokenizer for NodeJS/Browser
13 versions - Latest release: about 1 year ago - 75 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-llama3_1 3.7.2
llama3_1 tokenizer for NodeJS/Browser
6 versions - Latest release: about 1 year ago - 406 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-gemma2 3.7.2
gemma2 tokenizer for NodeJS/Browser
5 versions - Latest release: about 1 year ago - 2.25 thousand downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-qwen2_5 3.7.2
qwen2_5 tokenizer for NodeJS/Browser
5 versions - Latest release: about 1 year ago - 243 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-deepseek_v4 3.7.2
deepseek_v4 tokenizer for NodeJS/Browser
1 version - Latest release: 6 months ago - 35 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-llama3 3.7.2
llama3 tokenizer for NodeJS/Browser
12 versions - Latest release: about 1 year ago - 1.1 thousand downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-gpt4 3.7.2
gpt4 tokenizer for NodeJS/Browser
13 versions - Latest release: about 1 year ago - 211 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-baichuan2 3.7.2
baichuan2 tokenizer for NodeJS/Browser
14 versions - Latest release: about 1 year ago - 24 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizers 3.7.2
a lightweight no-dependency fork of transformers.js (only tokenizers)
15 versions - Latest release: about 1 year ago - 108 thousand downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-text_davinci003 3.7.2
text_davinci003 tokenizer for NodeJS/Browser
13 versions - Latest release: about 1 year ago - 11 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-mistral_nemo 3.7.2
mistral_nemo tokenizer for NodeJS/Browser
5 versions - Latest release: about 1 year ago - 5.15 thousand downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-gpt4o 3.7.2
gpt4o tokenizer for NodeJS/Browser
11 versions - Latest release: about 1 year ago - 321 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-qwen3 3.7.2
qwen3 tokenizer for NodeJS/Browser
2 versions - Latest release: about 1 year ago - 2.64 thousand downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-internlm2 3.7.2
internlm2 tokenizer for NodeJS/Browser
13 versions - Latest release: about 1 year ago - 22 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-gpt35turbo 3.7.2
gpt35turbo tokenizer for NodeJS/Browser
13 versions - Latest release: about 1 year ago - 224 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-gemma 3.7.2
gemma tokenizer for NodeJS/Browser
14 versions - Latest release: about 1 year ago - 288 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-gemma3 3.7.2
gemma3 tokenizer for NodeJS/Browser
3 versions - Latest release: about 1 year ago - 52.6 thousand downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-gpt35turbo16k 3.7.2
gpt35turbo16k tokenizer for NodeJS/Browser
13 versions - Latest release: about 1 year ago - 21 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-gpt2 3.7.2
gpt2 tokenizer for NodeJS/Browser
13 versions - Latest release: about 1 year ago - 153 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-text_davinci002 3.7.2
text_davinci002 tokenizer for NodeJS/Browser
13 versions - Latest release: about 1 year ago - 84 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-yi 3.7.2
yi tokenizer for NodeJS/Browser
13 versions - Latest release: about 1 year ago - 48 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-gemini 3.7.2
gemini tokenizer for NodeJS/Browser
5 versions - Latest release: about 1 year ago - 17 thousand downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-claude 3.7.2
claude tokenizer for NodeJS/Browser
14 versions - Latest release: about 1 year ago - 15.4 thousand downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-gptoss 3.7.2
gptoss tokenizer for NodeJS/Browser
1 version - Latest release: about 1 year ago - 348 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-gpt3 3.7.2
gpt3 tokenizer for NodeJS/Browser
13 versions - Latest release: about 1 year ago - 94 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-claude1 3.7.2
claude1 tokenizer for NodeJS/Browser
14 versions - Latest release: about 1 year ago - 30 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-minicpm_v4_5 3.7.2
minicpm_v4_5 tokenizer for NodeJS/Browser
1 version - Latest release: about 1 year ago - 10 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-llama2 3.7.2
llama2 tokenizer for NodeJS/Browser
13 versions - Latest release: about 1 year ago - 3.25 thousand downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-chatglm3 3.7.2
chatglm3 tokenizer for NodeJS/Browser
14 versions - Latest release: about 1 year ago - 233 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-llama3_2 3.7.2
llama3_2 tokenizer for NodeJS/Browser
4 versions - Latest release: about 1 year ago - 326 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-deepseek_v3 3.7.2
deepseek_v3 tokenizer for NodeJS/Browser
4 versions - Latest release: about 1 year ago - 5.69 thousand downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-aya_expanse 3.7.2
aya_expanse tokenizer for NodeJS/Browser
5 versions - Latest release: about 1 year ago - 27 downloads last month - 34 stars on GitHub - 1 maintainer
@lenml/tokenizer-command_r_plus 3.7.2
command_r_plus tokenizer for NodeJS/Browser
13 versions - Latest release: about 1 year ago - 47 downloads last month - 34 stars on GitHub - 1 maintainer
epayco-tokenizer 1.0.6
Agnostic browser tokenizer for epayco
7 versions - Latest release: almost 8 years ago - 2 dependent packages - 2 dependent repositories - 22 downloads last month - 0 stars on GitHub - 1 maintainer
@cjser/tokenizer__inflate 0.6.0-cjser.2 πŸ’°
Tokenized zip support
3 versions - Latest release: about 22 hours ago - 66 downloads last month - 1 maintainer