npmjs.org "tokenize" keyword
deconcat 0.0.1 π°
Tokenize a Concatenation Expression1 version - Latest release: over 5 years ago - 2 dependent packages - 2 dependent repositories - 28 downloads last month - 0 stars on GitHub - 1 maintainer
cssprima 0.1.0
The most standards compliant CSS parser.1 version - Latest release: over 12 years ago - 3 dependent packages - 1 dependent repositories - 12 downloads last month - 30 stars on GitHub - 1 maintainer
Top 9.3% on npmjs.org
9 versions - Latest release: almost 10 years ago - 2 dependent packages - 9 dependent repositories - 2.29 thousand downloads last month - 3 stars on GitHub - 1 maintainer
css-tokens 2.0.0 deprecated
A regex that tokenizes CSS.9 versions - Latest release: almost 10 years ago - 2 dependent packages - 9 dependent repositories - 2.29 thousand downloads last month - 3 stars on GitHub - 1 maintainer
Top 4.4% on npmjs.org
2 versions - Latest release: almost 12 years ago - 8 dependent packages - 9,559 dependent repositories - 3.16 million downloads last month - 6 stars on GitHub - 1 maintainer
css-tokenize 1.0.1
Transform stream that tokenizes CSS2 versions - Latest release: almost 12 years ago - 8 dependent packages - 9,559 dependent repositories - 3.16 million downloads last month - 6 stars on GitHub - 1 maintainer
Top 1.5% on npmjs.org
33 versions - Latest release: over 5 years ago - 943 dependent packages - 3,779,990 dependent repositories - 44.4 million downloads last month - 224 stars on GitHub - 3 maintainers
snapdragon 0.12.1
Easy-to-use plugin system for creating powerful, fast and versatile parsers and compilers, with b...33 versions - Latest release: over 5 years ago - 943 dependent packages - 3,779,990 dependent repositories - 44.4 million downloads last month - 224 stars on GitHub - 3 maintainers
Top 6.8% on npmjs.org
1 version - Latest release: almost 11 years ago - 2 dependent packages - 81 dependent repositories - 8.85 thousand downloads last month - 1 stars on GitHub - 1 maintainer
tokenize-whitespace 0.0.1
Tokenize a string into words and whitespace tokens1 version - Latest release: almost 11 years ago - 2 dependent packages - 81 dependent repositories - 8.85 thousand downloads last month - 1 stars on GitHub - 1 maintainer
count-pieces 0.1.0
Gives you an inventory of tokens needed to write a given program1 version - Latest release: over 9 years ago - 2 dependent packages - 1 dependent repositories - 4 downloads last month - 0 stars on GitHub - 1 maintainer
Top 1.3% on npmjs.org
25 versions - Latest release: 11 months ago - 2,251 dependent packages - 1,940,799 dependent repositories - 858 million downloads last month - 555 stars on GitHub - 1 maintainer
js-tokens 10.0.0
Tiny JavaScript tokenizer.25 versions - Latest release: 11 months ago - 2,251 dependent packages - 1,940,799 dependent repositories - 858 million downloads last month - 555 stars on GitHub - 1 maintainer
prism-liquibase 0.0.4
Bash Language Extension for tokenizing Liquibase CLI command keywords.4 versions - Latest release: over 6 years ago - 2 dependent packages - 26 downloads last month - 7 stars on GitHub - 1 maintainer
Top 3.4% on npmjs.org
2 versions - Latest release: over 8 years ago - 11 dependent packages - 1,043,711 dependent repositories - 2.18 million downloads last month - 14 stars on GitHub - 1 maintainer
babel-extract-comments 1.0.0 π°
Uses babel (babylon) to extract JavaScript code comments from a JavaScript string or file.2 versions - Latest release: over 8 years ago - 11 dependent packages - 1,043,711 dependent repositories - 2.18 million downloads last month - 14 stars on GitHub - 1 maintainer
Top 7.7% on npmjs.org
9 versions - Latest release: over 5 years ago - 2 dependent packages - 42 dependent repositories - 7.13 thousand downloads last month - 2 stars on GitHub - 1 maintainer
complexion-js 0.2.2
Tokenize JavaScript9 versions - Latest release: over 5 years ago - 2 dependent packages - 42 dependent repositories - 7.13 thousand downloads last month - 2 stars on GitHub - 1 maintainer
complexion-time-map 1.1.0
Time a JavaScript tokenizer4 versions - Latest release: over 9 years ago - 2 dependent packages - 4 dependent repositories - 34 downloads last month - 0 stars on GitHub - 1 maintainer
Top 5.5% on npmjs.org
7 versions - Latest release: over 5 years ago - 5 dependent packages - 44 dependent repositories - 8.84 thousand downloads last month - 5 stars on GitHub - 1 maintainer
complexion 0.2.2
A fast tokenizer/lexer core that is well tested.7 versions - Latest release: over 5 years ago - 5 dependent packages - 44 dependent repositories - 8.84 thousand downloads last month - 5 stars on GitHub - 1 maintainer
Top 1.3% on npmjs.org
8 versions - Latest release: almost 2 years ago - 26 dependent packages - 49,418 dependent repositories - 235 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-util-resolve-all 2.0.1 π°
micromark utility to resolve subtokens8 versions - Latest release: almost 2 years ago - 26 dependent packages - 49,418 dependent repositories - 235 million downloads last month - 2,236 stars on GitHub - 1 maintainer
@ohos-ports/stdlib-string-base-format-tokenize 0.2.4-beta.0 π°
Tokenize a string into an array of string parts and format identifier objects.2 versions - Latest release: about 9 hours ago - 6 stars on GitHub - 10 maintainers
@ohos-ports/stdlib-string-base-format-interpolate 0.2.4-beta.1 π°
Generate string from a token array by interpolating values.3 versions - Latest release: about 9 hours ago - 6 stars on GitHub - 10 maintainers
Top 1.2% on npmjs.org
8 versions - Latest release: almost 2 years ago - 31 dependent packages - 49,517 dependent repositories - 234 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-factory-whitespace 2.0.1 π°
micromark factory to parse markdown whitespace (found in lots of places)8 versions - Latest release: almost 2 years ago - 31 dependent packages - 49,517 dependent repositories - 234 million downloads last month - 2,236 stars on GitHub - 1 maintainer
cljs-tokenizer 0.0.0
Clojurescript tokenizer1 version - Latest release: almost 13 years ago - 1 dependent package - 1 dependent repositories - 21 downloads last month - 0 stars on GitHub - 1 maintainer
@flex-development/mark-parser 1.0.0-alpha.21 π°
finite state machine tokenizer12 versions - Latest release: about 11 hours ago - 1.29 thousand downloads last month - 1 stars on GitHub - 1 maintainer
@flex-development/mark 1.0.0-alpha.12 π°
core types and interfaces for mark12 versions - Latest release: 14 days ago - 4.73 thousand downloads last month - 1 stars on GitHub - 1 maintainer
@flex-development/mark-util-symbol 3.1.0 π°
mark symbol utility6 versions - Latest release: 4 months ago - 2.46 thousand downloads last month - 1 stars on GitHub - 1 maintainer
Top 3.7% on npmjs.org
7 versions - Latest release: about 2 years ago - 89 dependent packages - 7,730 dependent repositories - 57 million downloads last month - 42 stars on GitHub - 2 maintainers
hast-util-from-html 2.0.3 π°
hast utility to parse from HTML7 versions - Latest release: about 2 years ago - 89 dependent packages - 7,730 dependent repositories - 57 million downloads last month - 42 stars on GitHub - 2 maintainers
@depup/mdast-util-from-markdown 2.1.0-depup.0 π°
mdast utility to parse markdown (with updated dependencies)2 versions - Latest release: 26 days ago - 215 downloads last month - 295 stars on GitHub - 1 maintainer
Top 1.7% on npmjs.org
33 versions - Latest release: 26 days ago - 315 dependent packages - 144,051 dependent repositories - 235 million downloads last month - 295 stars on GitHub - 2 maintainers
mdast-util-from-markdown 2.1.0 π°
mdast utility to parse markdown33 versions - Latest release: 26 days ago - 315 dependent packages - 144,051 dependent repositories - 235 million downloads last month - 295 stars on GitHub - 2 maintainers
Top 1.2% on npmjs.org
8 versions - Latest release: almost 2 years ago - 33 dependent packages - 49,418 dependent repositories - 227 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-util-chunked 2.0.1 π°
micromark utility to splice and push with giant arrays8 versions - Latest release: almost 2 years ago - 33 dependent packages - 49,418 dependent repositories - 227 million downloads last month - 2,236 stars on GitHub - 1 maintainer
c-tokenizer 1.0.0
tokenize c/c++ source code2 versions - Latest release: about 10 years ago - 4 dependent packages - 3 dependent repositories - 91 downloads last month - 44 stars on - 1 maintainer
@depup/micromark-util-decode-string 2.0.1-depup.0 π°
[DepUp] micromark utility to decode markdown strings1 version - Latest release: 8 months ago - 11 downloads last month - 2,233 stars on GitHub - 1 maintainer
Top 1.4% on npmjs.org
8 versions - Latest release: almost 2 years ago - 15 dependent packages - 49,391 dependent repositories - 223 million downloads last month - 2,233 stars on GitHub - 1 maintainer
micromark-factory-destination 2.0.1 π°
micromark factory to parse destinations (found in resources, definitions)8 versions - Latest release: almost 2 years ago - 15 dependent packages - 49,391 dependent repositories - 223 million downloads last month - 2,233 stars on GitHub - 1 maintainer
Top 1.0% on npmjs.org
43 versions - Latest release: about 1 month ago - 144 dependent packages - 151,327 dependent repositories - 241 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark 4.0.3 π°
small commonmark compliant markdown parser with positional info and concrete tokens43 versions - Latest release: about 1 month ago - 144 dependent packages - 151,327 dependent repositories - 241 million downloads last month - 2,236 stars on GitHub - 1 maintainer
Top 1.1% on npmjs.org
11 versions - Latest release: almost 2 years ago - 82 dependent packages - 49,741 dependent repositories - 288 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-util-character 2.1.1 π°
micromark utility to handle character codes11 versions - Latest release: almost 2 years ago - 82 dependent packages - 49,741 dependent repositories - 288 million downloads last month - 2,236 stars on GitHub - 1 maintainer
Top 1.1% on npmjs.org
12 versions - Latest release: about 1 month ago - 95 dependent packages - 49,745 dependent repositories - 263 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-util-types 2.0.3 π°
micromark utility with a couple of typescript types12 versions - Latest release: about 1 month ago - 95 dependent packages - 49,745 dependent repositories - 263 million downloads last month - 2,236 stars on GitHub - 1 maintainer
Top 1.4% on npmjs.org
6 versions - Latest release: almost 2 years ago - 17 dependent packages - 48,161 dependent repositories - 218 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-util-decode-string 2.0.1 π°
micromark utility to decode markdown strings6 versions - Latest release: almost 2 years ago - 17 dependent packages - 48,161 dependent repositories - 218 million downloads last month - 2,236 stars on GitHub - 1 maintainer
Top 1.4% on npmjs.org
10 versions - Latest release: almost 2 years ago - 15 dependent packages - 49,391 dependent repositories - 226 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-factory-label 2.0.1 π°
micromark factory to parse labels (found in media, definitions)10 versions - Latest release: almost 2 years ago - 15 dependent packages - 49,391 dependent repositories - 226 million downloads last month - 2,236 stars on GitHub - 1 maintainer
Top 1.3% on npmjs.org
8 versions - Latest release: almost 2 years ago - 22 dependent packages - 49,415 dependent repositories - 224 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-util-classify-character 2.0.1 π°
micromark utility to classify whether a character is whitespace or punctuation8 versions - Latest release: almost 2 years ago - 22 dependent packages - 49,415 dependent repositories - 224 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-util-edit-map 1.0.0 π°
micromark utility to batch changes to lists of events1 version - Latest release: about 1 month ago - 21 million downloads last month - 2,233 stars on GitHub - 1 maintainer
Top 1.2% on npmjs.org
17 versions - Latest release: about 1 month ago - 34 dependent packages - 49,395 dependent repositories - 238 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-core-commonmark 2.0.4 π°
The CommonMark markdown constructs17 versions - Latest release: about 1 month ago - 34 dependent packages - 49,395 dependent repositories - 238 million downloads last month - 2,236 stars on GitHub - 1 maintainer
@depup/micromark-factory-space 2.1.0-depup.0 π°
micromark factory to parse markdown space (found in lots of places) (with updated dependencies)2 versions - Latest release: about 1 month ago - 43 downloads last month - 2,236 stars on GitHub - 1 maintainer
Top 1.3% on npmjs.org
9 versions - Latest release: almost 2 years ago - 26 dependent packages - 49,519 dependent repositories - 240 million downloads last month - 2,233 stars on GitHub - 1 maintainer
micromark-util-sanitize-uri 2.0.1 π°
micromark utility to sanitize urls9 versions - Latest release: almost 2 years ago - 26 dependent packages - 49,519 dependent repositories - 240 million downloads last month - 2,233 stars on GitHub - 1 maintainer
Top 1.4% on npmjs.org
10 versions - Latest release: almost 2 years ago - 15 dependent packages - 49,391 dependent repositories - 223 million downloads last month - 2,233 stars on GitHub - 1 maintainer
micromark-factory-title 2.0.1 π°
micromark factory to parse markdown titles (found in resources, definitions)10 versions - Latest release: almost 2 years ago - 15 dependent packages - 49,391 dependent repositories - 223 million downloads last month - 2,233 stars on GitHub - 1 maintainer
Top 1.3% on npmjs.org
8 versions - Latest release: almost 2 years ago - 29 dependent packages - 49,411 dependent repositories - 234 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-util-combine-extensions 2.0.1 π°
micromark utility to combine syntax or html extensions8 versions - Latest release: almost 2 years ago - 29 dependent packages - 49,411 dependent repositories - 234 million downloads last month - 2,236 stars on GitHub - 1 maintainer
@depup/micromark-util-types 2.0.3-depup.0 π°
micromark utility with a couple of typescript types (with updated dependencies)2 versions - Latest release: about 1 month ago - 47 downloads last month - 2,236 stars on GitHub - 1 maintainer
Top 1.4% on npmjs.org
14 versions - Latest release: over 1 year ago - 16 dependent packages - 49,392 dependent repositories - 234 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-util-subtokenize 2.1.0 π°
micromark utility to tokenize subtokens14 versions - Latest release: over 1 year ago - 16 dependent packages - 49,392 dependent repositories - 234 million downloads last month - 2,236 stars on GitHub - 1 maintainer
Top 3.3% on npmjs.org
14 versions - Latest release: about 1 month ago - 23 dependent packages - 30 dependent repositories - 4.74 thousand downloads last month - 2,233 stars on GitHub - 1 maintainer
micromark-build 2.0.4 π°
Build production files from dev files14 versions - Latest release: about 1 month ago - 23 dependent packages - 30 dependent repositories - 4.74 thousand downloads last month - 2,233 stars on GitHub - 1 maintainer
Top 1.4% on npmjs.org
9 versions - Latest release: almost 2 years ago - 14 dependent packages - 49,392 dependent repositories - 228 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-util-html-tag-name 2.0.1 π°
micromark utility with list of html tag names9 versions - Latest release: almost 2 years ago - 14 dependent packages - 49,392 dependent repositories - 228 million downloads last month - 2,236 stars on GitHub - 1 maintainer
Top 1.4% on npmjs.org
9 versions - Latest release: almost 2 years ago - 16 dependent packages - 49,516 dependent repositories - 256 million downloads last month - 2,233 stars on GitHub - 1 maintainer
micromark-util-encode 2.0.1 π°
micromark utility to encode dangerous html characters9 versions - Latest release: almost 2 years ago - 16 dependent packages - 49,516 dependent repositories - 256 million downloads last month - 2,233 stars on GitHub - 1 maintainer
@depup/micromark-factory-whitespace 2.0.1-depup.1 π°
micromark factory to parse markdown whitespace (found in lots of places) (with updated dependencies)2 versions - Latest release: about 1 month ago - 225 downloads last month - 2,233 stars on GitHub - 1 maintainer
Top 1.2% on npmjs.org
8 versions - Latest release: almost 2 years ago - 28 dependent packages - 49,409 dependent repositories - 235 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-util-normalize-identifier 2.0.1 π°
micromark utility normalize identifiers (as found in references, definitions)8 versions - Latest release: almost 2 years ago - 28 dependent packages - 49,409 dependent repositories - 235 million downloads last month - 2,236 stars on GitHub - 1 maintainer
Top 1.1% on npmjs.org
9 versions - Latest release: almost 2 years ago - 86 dependent packages - 49,751 dependent repositories - 298 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-util-symbol 2.0.1 π°
micromark utility with symbols9 versions - Latest release: almost 2 years ago - 86 dependent packages - 49,751 dependent repositories - 298 million downloads last month - 2,236 stars on GitHub - 1 maintainer
@depup/micromark-core-commonmark 2.0.4-depup.0 π°
The CommonMark markdown constructs (with updated dependencies)2 versions - Latest release: about 1 month ago - 228 downloads last month - 2,233 stars on GitHub - 1 maintainer
@depup/micromark 4.0.3-depup.0 π°
small commonmark compliant markdown parser with positional info and concrete tokens (with updated...2 versions - Latest release: about 1 month ago - 65 downloads last month - 2,236 stars on GitHub - 1 maintainer
@depup/micromark-factory-title 2.0.1-depup.1 π°
micromark factory to parse markdown titles (found in resources, definitions) (with updated depend...2 versions - Latest release: about 1 month ago - 48 downloads last month - 2,236 stars on GitHub - 1 maintainer
Top 1.4% on npmjs.org
6 versions - Latest release: almost 2 years ago - 17 dependent packages - 49,462 dependent repositories - 226 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-util-decode-numeric-character-reference 2.0.2 π°
micromark utility to decode numeric character references6 versions - Latest release: almost 2 years ago - 17 dependent packages - 49,462 dependent repositories - 226 million downloads last month - 2,236 stars on GitHub - 1 maintainer
Top 1.2% on npmjs.org
9 versions - Latest release: about 1 month ago - 57 dependent packages - 49,586 dependent repositories - 257 million downloads last month - 2,236 stars on GitHub - 1 maintainer
micromark-factory-space 2.1.0 π°
micromark factory to parse markdown space (found in lots of places)9 versions - Latest release: about 1 month ago - 57 dependent packages - 49,586 dependent repositories - 257 million downloads last month - 2,236 stars on GitHub - 1 maintainer
parse5-wxmp 3.0.3 π°
HTML parsing/serialization toolset for Node.js. WHATWG HTML Living Standard (aka HTML5)-compliant.1 version - Latest release: about 9 years ago - 2 dependent packages - 1 dependent repositories - 16 downloads last month - 3,938 stars on GitHub - 1 maintainer
@modelmap/excel-formula-tokenizer 2.3.2
Tokenize Excel formulas2 versions - Latest release: almost 6 years ago - 2 dependent packages - 1 dependent repositories - 115 downloads last month - 0 stars on GitHub - 1 maintainer
json-tokenize 0.3.0
Splits a JSON string into an annotated list of tokens3 versions - Latest release: over 9 years ago - 2 dependent packages - 1 dependent repositories - 33 downloads last month - 66 stars on GitHub - 1 maintainer
Top 2.1% on npmjs.org
12 versions - Latest release: over 6 years ago - 32 dependent packages - 8,222 dependent repositories - 3.74 million downloads last month - 67 stars on GitHub - 1 maintainer
html-tokenize 2.0.1
transform stream to tokenize html12 versions - Latest release: over 6 years ago - 32 dependent packages - 8,222 dependent repositories - 3.74 million downloads last month - 67 stars on GitHub - 1 maintainer
Top 3.8% on npmjs.org
2 versions - Latest release: about 14 years ago - 21 dependent packages - 156 dependent repositories - 42.2 thousand downloads last month - 21 stars on GitHub - 1 maintainer
StringScanner 0.0.3
StringScanner performs lexical scanning operations on a string.2 versions - Latest release: about 14 years ago - 21 dependent packages - 156 dependent repositories - 42.2 thousand downloads last month - 21 stars on GitHub - 1 maintainer
Top 6.3% on npmjs.org
11 versions - Latest release: 9 months ago - 4 dependent packages - 801 dependent repositories - 2.64 million downloads last month - 1 stars on GitHub - 4 maintainers
@stdlib/string-base-format-interpolate 0.2.4 π°
Generate string from a token array by interpolating values.11 versions - Latest release: 9 months ago - 4 dependent packages - 801 dependent repositories - 2.64 million downloads last month - 1 stars on GitHub - 4 maintainers
@technobuddha/library 2.0.3
A large library of useful functions20 versions - Latest release: about 1 year ago - 3 dependent packages - 1 dependent repositories - 56 downloads last month - 0 stars on GitHub - 1 maintainer
Top 6.9% on npmjs.org
14 versions - Latest release: over 12 years ago - 10 dependent packages - 32 dependent repositories - 939 downloads last month - 6 stars on GitHub - 2 maintainers
strings 0.4.2 π°
Easily replace and transform :props in strings.14 versions - Latest release: over 12 years ago - 10 dependent packages - 32 dependent repositories - 939 downloads last month - 6 stars on GitHub - 2 maintainers
snapdragon-scanner 1.0.0
Easily scan a string with an object of regex patterns to produce an array of tokens. ~100 sloc.1 version - Latest release: almost 8 years ago - 1 dependent repositories - 9 downloads last month - 8 stars on GitHub - 1 maintainer
@teplovs/lexer 2.2.0 removed
JavaScript library for tokenizing strings with regular expressions12 versions - Latest release: over 4 years ago - 2 dependent packages - 1 dependent repositories - 38 downloads last month - 1 maintainer
tokenize-file 0.1.7
Read a file, tokenize it, and spit out a handy JSON.8 versions - Latest release: over 8 years ago - 1 dependent package - 8 dependent repositories - 21 downloads last month - 2 stars on GitHub - 1 maintainer
tokenize-insa-station-name 1.1.0 π°
Get search tokens from an INSA/NASA station name.2 versions - Latest release: over 6 years ago - 1 dependent package - 8 downloads last month - 0 stars on GitHub - 1 maintainer
separo 0.0.2 π°
A Smarter String Split. Preserve Separator and more!2 versions - Latest release: over 5 years ago - 1 dependent package - 2 dependent repositories - 23 downloads last month - 0 stars on GitHub - 1 maintainer
dioscuri 2.0.0 π°
A gemtext (`text/gemini`) parser with support for streaming, ASTs, and CSTs7 versions - Latest release: 5 months ago - 1 dependent package - 2 dependent repositories - 42 downloads last month - 43 stars on GitHub - 1 maintainer
@laosb/dioscuri 1.1.0-laosbpatch.0 π°
A gemtext (`text/gemini`) parser with support for streaming, ASTs, and CSTs1 version - Latest release: over 5 years ago - 1 dependent package - 14 downloads last month - 43 stars on GitHub - 1 maintainer
poketh 0.6.11
string/array poking for pet params11 versions - Latest release: almost 12 years ago - 1 dependent package - 1 dependent repositories - 24 downloads last month - 1 maintainer
ansi-tokenize 0.2.0 deprecated
transform stream to tokenize ansi into escape codes and literals2 versions - Latest release: about 11 years ago - 4 dependent packages - 1 dependent repositories - 18 downloads last month - 0 stars on GitHub - 1 maintainer
@schemed/core 1.0.0
Abstract TypeScript template engine2 versions - Latest release: over 4 years ago - 2 dependent packages - 4 downloads last month - 4 stars on GitHub - 1 maintainer
Top 9.6% on npmjs.org
4 versions - Latest release: over 8 years ago - 3 dependent packages - 36 dependent repositories - 10.5 thousand downloads last month - 0 stars on GitHub - 3 maintainers
@nxmix/tokenize-ansi 3.0.0
tokenize a string that includes ansi code4 versions - Latest release: over 8 years ago - 3 dependent packages - 36 dependent repositories - 10.5 thousand downloads last month - 0 stars on GitHub - 3 maintainers
@liquicode/lib-tokenize 0.1.4
A NodeJS library to tokenize strings5 versions - Latest release: almost 6 years ago - 2 dependent packages - 1 dependent repositories - 10 downloads last month - 0 stars on GitHub - 1 maintainer
@kessler/tokenize 2.0.0
personal tokenize util4 versions - Latest release: over 6 years ago - 2 dependent packages - 1 dependent repositories - 42 downloads last month - 4 stars on GitHub - 1 maintainer
@k14v/printf-tokenize 0.0.6
printf format string tokenize6 versions - Latest release: about 2 years ago - 3 dependent packages - 2 dependent repositories - 28 downloads last month - 0 stars on GitHub - 2 maintainers
@flowaccount/node-icu-tokenizer 2.0.0
String Tokenizer for Node.js using ICU's BreakIterators13 versions - Latest release: about 3 years ago - 1 dependent package - 750 downloads last month - 3 stars on GitHub - 5 maintainers
3h-ast 0.14.0
A simple AST generator.25 versions - Latest release: almost 5 years ago - 3 dependent packages - 1 dependent repositories - 8 downloads last month - 0 stars on GitHub - 1 maintainer
dsh-fulltext-index 0.1.0
In-memory full-text search plugin for DeepSeek Harness: inverted index with deterministic tokeniz...2 versions - Latest release: 5 days ago - 1 maintainer
@adhd/sox-tokenguard-core 0.2.1
Pure, IO-light TypeScript port of the TokenGuard bijective tokenize/detokenize engine2 versions - Latest release: about 2 months ago - 230 downloads last month - 0 stars on GitHub - 1 maintainer
Top 1.7% on npmjs.org
21 versions - Latest release: about 11 years ago - 53 dependent packages - 972 dependent repositories - 299 thousand downloads last month - 408 stars on GitHub - 1 maintainer
lex 1.7.9 deprecated π°
An elegant armor-plated JavaScript lexer modelled after flex. Easily extensible to tailor to your...21 versions - Latest release: about 11 years ago - 53 dependent packages - 972 dependent repositories - 299 thousand downloads last month - 408 stars on GitHub - 1 maintainer
@flex-development/docmark 1.0.0-alpha.22 π°
commonmark compliant documentation parser with positional info and concrete tokens26 versions - Latest release: 8 days ago - 2.7 thousand downloads last month - 1 stars on GitHub - 1 maintainer
Top 2.1% on npmjs.org
43 versions - Latest release: over 1 year ago - 17 dependent packages - 48 dependent repositories - 714 thousand downloads last month - 1,394 stars on GitHub - 1 maintainer
wink-nlp 2.4.0
Developer friendly Natural Language Processing β¨43 versions - Latest release: over 1 year ago - 17 dependent packages - 48 dependent repositories - 714 thousand downloads last month - 1,394 stars on GitHub - 1 maintainer
tokenize-sync 2.0.0 π°
Simple synchronous string tokenizer using Regex2 versions - Latest release: almost 9 years ago - 3 dependent packages - 2 dependent repositories - 15 downloads last month - 1 stars on GitHub - 1 maintainer
anyword 2.0.2
Micro text segmenter β locale-correct words, graphemes and sentences, safe counting and truncatio...4 versions - Latest release: about 2 months ago - 406 downloads last month - 1 stars on GitHub - 1 maintainer
Top 8.4% on npmjs.org
7 versions - Latest release: over 5 years ago - 1 dependent package - 7 dependent repositories - 607 downloads last month - 81 stars on GitHub - 1 maintainer
tokenize2 1.3.5 unpublished
Plugin which allows your users to select multiple items from a predefined list or ajax, using aut...7 versions - Latest release: over 5 years ago - 1 dependent package - 7 dependent repositories - 607 downloads last month - 81 stars on GitHub - 1 maintainer
@referralgps/selectra 1.1.0 π°
Selectra β A powerful, extensible <select> UI control for tagging, contact lists, country selecto...8 versions - Latest release: 8 months ago - 538 downloads last month - 3 stars on GitHub - 2 maintainers
@flex-development/docmark-util-combine-extensions 1.0.0-alpha.22 π°
docmark utility to combine extensions26 versions - Latest release: 8 days ago - 2.4 thousand downloads last month - 1 stars on GitHub - 1 maintainer
@flex-development/docmark-util-subtokenize 1.0.0-alpha.22 π°
docmark utility to tokenize subtokens26 versions - Latest release: 8 days ago - 2.33 thousand downloads last month - 1 stars on GitHub - 1 maintainer
@flex-development/docmark-grammar 1.0.0-alpha.22 π°
core docmark constructs and utilities26 versions - Latest release: 8 days ago - 2.93 thousand downloads last month - 1 stars on GitHub - 1 maintainer
json-tokenizer 1.1.0
A streaming JSON tokenizer3 versions - Latest release: about 9 years ago - 6 dependent packages - 6 dependent repositories - 130 downloads last month - 5 stars on GitHub - 1 maintainer
@validapay/tokenize 1.4.0
TokenizaΓ§Γ£o de cartΓ£o e identificaΓ§Γ£o do dispositivo para antifraude ValidaPay6 versions - Latest release: 9 days ago - 91 downloads last month - 1 maintainer
clawpump 0.11.0
Launch a token on ClawPump from your terminal β Solana, Uniswap pools.trade, or Robinhood Chain. ...13 versions - Latest release: about 2 months ago - 1.28 thousand downloads last month - 2 maintainers
@lexiprep/core 0.8.0
Reusable pipeline: ebook (EPUB/PDF) -> clean text -> word tokens -> frequency list. Framework-agn...9 versions - Latest release: 4 months ago - 0 stars on GitHub - 1 maintainer
@cjser/micromark-util-subtokenize 2.1.0-cjser.2 π°
micromark utility to tokenize subtokens1 version - Latest release: 6 months ago - 1 maintainer
@pii-mask/core 0.2.1
Zero-dependency PII masking engine with detector registry, all modes, and all detectors.3 versions - Latest release: 7 months ago - 54 downloads last month - 1 stars on GitHub - 1 maintainer
selector-checker 0.9.2
Module for fast element to selector matching (with custom :hover, :focus etc. handing)3 versions - Latest release: almost 10 years ago - 1 dependent repositories - 4 downloads last month - 0 stars on GitHub - 1 maintainer
@axontraining-sistemas/tokenize-card 1.0.2
Package for card's tokenization3 versions - Latest release: about 4 years ago - 10 downloads last month - 1 maintainer
@nojaja/tokenize-comment 3.0.2 π°
Uses snapdragon to tokenize a single JavaScript block comment into an object, with description, t...2 versions - Latest release: 10 months ago - 4 downloads last month - 0 stars on GitHub - 1 maintainer
bracketter-js 0.0.2
Parse and manipulate tokenized strings with ease!2 versions - Latest release: over 3 years ago - 20 downloads last month - 0 stars on GitHub - 1 maintainer
nomark 1.0.1
Transform hypertext strings (e.g., HTML, Markdown) into plain text for natural language processin...2 versions - Latest release: about 2 years ago - 185 downloads last month - 1 stars on GitHub - 1 maintainer
Related Keywords
parse
88
tokenizer
72
token
65
ast
49
lexer
44
markdown
42
parser
42
compile
38
render
36
gfm
34
cst
32
commonmark
32
unified
31
micromark
30
utility
30
util
29
string
26
javascript
25
html
25
nlp
22
tokens
22
text
20
lex
19
nodejs
17
node
15
typescript
14
split
14
transform
11
scanner
11
js
10
comment
10
compiler
10
convert
10
syntax
10
code
9
lexical
9
mdast
9
search
9
unist
9
tokenization
9
regex
9
security
8
factory
8
parsing
8
depup
8
analysis
8
patched
7
stream
7
normalize
7
css
7
updated-dependencies
7
latest
7
jonschlinkert
6
character
6
json
6
fast
6
cli
6
words
6
tokenise
6
snapdragon
6
scan
6
html5
5
tokeniser
5
html parser
5
html5 parser
5
htmlparser
5
serialize
5
regexp
5
docast
5
docblock
5
documentation
5
replace
5
md
5
utilities
5
utils
5
str
5
tags
5
word
4
glob
4
stackgl
4
stdstring
4
stdlib
4
format
4
natural-language-processing
4
extract
4
NLP
4
spec
4
tagger
4
replacer
4
glslify
4
unicode
4
ansi
4
fmt
4
types
4
formatting
4
markup
4
core
4
strip
4
glsl
4
whitespace
4