Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

npmjs.org "tokenizer" keyword

lexie 1.0.7
A cascade-based JS lexer implementation
8 versions - Latest release: over 4 years ago - 5 dependent packages - 1 dependent repositories - 16 downloads last month - 1 maintainer
@hiherto-elements/natural 0.0.4
minimal es6 natural language detection
4 versions - Latest release: over 5 years ago - 1 dependent package - 1 dependent repositories - 9 downloads last month - 2 stars on GitHub - 1 maintainer
jisons 1.0.0
A parser generator with Bison's API
1 version - Latest release: about 4 years ago - 1 dependent package - 1 dependent repositories - 7 downloads last month - 1 stars on GitHub - 1 maintainer
aliquamaut 1.3.0
A lightly-typescriptified version of jison
8 versions - Latest release: 2 months ago - 8 downloads last month - 1 maintainer
lexer-next 4.1.1
lexer for recursive descent parsers
13 versions - Latest release: over 1 year ago - 4 dependent packages - 2 dependent repositories - 642 downloads last month - 2 stars on GitHub - 1 maintainer
Top 9.6% on npmjs.org
@nfrasser/simple-html-tokenizer 0.5.11-2
Simple HTML Tokenizer is a lightweight JavaScript library that can be used to tokenize the kind o...
3 versions - Latest release: over 2 years ago - 6 dependent packages - 2 dependent repositories - 9 downloads last month - 3 stars on GitHub - 1 maintainer
@novel-segment/assert 1.0.12 💰
Chinese word segmentation 簡繁中文分词模块 以網路小說為樣本 基于 Node.js 的中文分词模块
11 versions - Latest release: 8 months ago - 1 dependent package - 14 downloads last month - 10 stars on GitHub - 1 maintainer
@candlelib/wind 0.5.7
Tokenizer
8 versions - Latest release: over 2 years ago - 10 dependent packages - 4 dependent repositories - 9 downloads last month - 0 stars on GitHub - 1 maintainer
Top 8.9% on npmjs.org
bert-tokenizer 1.1.8
A simple tool to generate bert tokens and input features
10 versions - Latest release: about 4 years ago - 2 dependent packages - 2 dependent repositories - 654 downloads last month - 5 stars on GitHub - 1 maintainer
bredon-minify 1.0.1 💰
Preconfigured Bredon Compiler to minify CSS values
2 versions - Latest release: over 6 years ago - 2 dependent packages - 1 dependent repositories - 7 downloads last month - 40 stars on GitHub - 1 maintainer
parse5-wxmp 3.0.3 💰
HTML parsing/serialization toolset for Node.js. WHATWG HTML Living Standard (aka HTML5)-compliant.
1 version - Latest release: almost 7 years ago - 2 dependent packages - 1 dependent repositories - 12 downloads last month - 3,564 stars on GitHub - 1 maintainer
bredon-tools 4.0.0 💰
Useful functional utilities for working with Bredon
5 versions - Latest release: over 6 years ago - 2 dependent packages - 1 dependent repositories - 5 downloads last month - 40 stars on GitHub - 1 maintainer
treebank-tokenizer 0.0.1 💰
NLTK TreebankTokenizer Ported from Python to JS
1 version - Latest release: over 2 years ago - 5 dependent repositories - 231 downloads last month - 1 stars on GitHub - 1 maintainer
n8n-nodes-gpt-tokenizer 0.1.1
n8n node for working with BPE Tokens with OpenAI's GPT models in mind.
1 version - Latest release: about 1 year ago - 43 downloads last month - 7 stars on GitHub - 1 maintainer
Top 1.4% on npmjs.org
@csstools/css-tokenizer 2.3.1 💰
Tokenize CSS
13 versions - Latest release: about 1 month ago - 30 dependent packages - 10,014 dependent repositories - 13 million downloads last month - 829 stars on GitHub - 3 maintainers
bulletin-board-code 1.0.2 💰
Parse BBCode to HTML.
10 versions - Latest release: about 2 months ago - 1 dependent package - 281 downloads last month - 10 stars on GitHub - 1 maintainer
random-web-token 2.2.1
Token generator/validator without external dependencies
28 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 161 downloads last month - 1 stars on GitHub - 1 maintainer
@yoannchb/wtf-json 1.0.6
Parse any kind of broken json for scrapping easily
6 versions - Latest release: about 1 month ago - 82 downloads last month - 0 stars on GitHub - 1 maintainer
lindera-js 0.1.4
A lidera japanese tokenizer wrapper for javascript and typescript
5 versions - Latest release: over 2 years ago - 1 dependent package - 1 dependent repositories - 11 downloads last month - 11 stars on GitHub - 1 maintainer
desql 0.3.0
An SQL parser
6 versions - Latest release: over 2 years ago - 1 dependent package - 5 downloads last month - 0 stars on GitHub - 1 maintainer
hx-tokenizer 1.0.0
Split text into tokens.
2 versions - Latest release: over 7 years ago - 1 dependent package - 1 dependent repositories - 5 downloads last month - 2 stars on GitHub - 1 maintainer
Top 5.7% on npmjs.org
string-punctuation-tokenizer 2.2.0
Small library that provides functions to tokenize a string into an array of words with or without...
29 versions - Latest release: almost 3 years ago - 16 dependent packages - 47 dependent repositories - 862 downloads last month - 8 stars on GitHub - 13 maintainers
@novel-segment/sort-synonym 1.0.24 💰
Chinese word segmentation 簡繁中文分词模块 以網路小說為樣本 基于 Node.js 的中文分词模块
24 versions - Latest release: about 1 month ago - 1 dependent package - 36 downloads last month - 10 stars on GitHub - 1 maintainer
@webkitty/searchbox 1.0.1
A search box supporting multiple user-defined keywords.
6 versions - Latest release: over 3 years ago - 1 dependent package - 1 dependent repositories - 5 downloads last month - 7 stars on GitHub - 2 maintainers
Top 2.1% on npmjs.org
gpt3-tokenizer 1.1.5 💰
[![Build](https://github.com/botisan-ai/gpt3-tokenizer/actions/workflows/main.yml/badge.svg)](htt...
9 versions - Latest release: over 1 year ago - 53 dependent packages - 983 dependent repositories - 102 thousand downloads last month - 172 stars on GitHub - 1 maintainer
lolcode 0.1.2
Parse LOLCODE to JavaScript
3 versions - Latest release: over 6 years ago - 2 dependent packages - 1 dependent repositories - 9 downloads last month - 9 stars on GitHub - 1 maintainer
lexers 1.0.0
It is a lexer and parser of C built using typescript
1 version - Latest release: 9 months ago - 6 downloads last month - 9 stars on GitHub - 1 maintainer
Top 1.8% on npmjs.org
@chevrotain/gast 11.0.3
Grammar AST structure for Chevrotain Parsers
13 versions - Latest release: 10 months ago - 3 dependent packages - 6,744 dependent repositories - 1.31 million downloads last month - 2,412 stars on GitHub - 1 maintainer
Top 0.8% on npmjs.org
chevrotain 11.0.3
Chevrotain is a high performance fault tolerant javascript parsing DSL for building recursive dec...
167 versions - Latest release: 10 months ago - 282 dependent packages - 17,129 dependent repositories - 3.89 million downloads last month - 2,412 stars on GitHub - 1 maintainer
Top 1.2% on npmjs.org
@chevrotain/types 11.0.3
Type Signatures and API Website for Chevrotain
18 versions - Latest release: 10 months ago - 13 dependent packages - 7,797 dependent repositories - 1.62 million downloads last month - 2,412 stars on GitHub - 1 maintainer
Top 1.6% on npmjs.org
@chevrotain/utils 11.0.3
common utilities
17 versions - Latest release: 10 months ago - 4 dependent packages - 7,794 dependent repositories - 1.62 million downloads last month - 2,412 stars on GitHub - 1 maintainer
node-tokenizer 0.0.0
A tokenizer written in JavaScript.
1 version - Latest release: over 11 years ago - 2 dependent packages - 6 dependent repositories - 7 downloads last month - 9 stars on GitHub - 1 maintainer
Top 7.4% on npmjs.org
segment-dict 2.3.207 💰
novel-segment segment data
467 versions - Latest release: about 1 month ago - 2 dependent packages - 161 dependent repositories - 27.3 thousand downloads last month - 10 stars on GitHub - 1 maintainer
Top 1.3% on npmjs.org
js-tokens 9.0.0
Tiny JavaScript tokenizer.
23 versions - Latest release: 4 months ago - 2,251 dependent packages - 1,940,799 dependent repositories - 205 million downloads last month - 482 stars on GitHub - 1 maintainer
manhattan-typeahead 1.0.18
Type-a-head and tokens for form fields.
25 versions - Latest release: over 1 year ago - 3 dependent packages - 2 dependent repositories - 12 downloads last month - 1 stars on GitHub - 1 maintainer
Top 0.9% on npmjs.org
react-bootstrap-typeahead 6.3.2
React typeahead with Bootstrap styling
173 versions - Latest release: 7 months ago - 226 dependent packages - 2,098 dependent repositories - 808 thousand downloads last month - 993 stars on GitHub - 1 maintainer
lexi 0.0.0
Fast & simple lexical analyzer
1 version - Latest release: about 10 years ago - 1 dependent package - 2 dependent repositories - 5 downloads last month - 0 stars on GitHub - 1 maintainer
@mejenborg/lexer 1.0.1
A simple TypeScript lexer
1 version - Latest release: almost 4 years ago - 1 dependent package - 3 downloads last month - 0 stars on GitHub - 1 maintainer
tiptap-annotation-magic 2.0.0
This is an extension for the [Tiptap](https://github.com/ueberdosis/tiptap) editor (based on Pros...
9 versions - Latest release: 9 months ago - 41 downloads last month - 25 stars on GitHub - 1 maintainer
@santerijps/tokenizer 1.0.3
A simple generic string tokenizer
4 versions - Latest release: about 1 month ago - 20 downloads last month - 0 stars on GitHub - 1 maintainer
Top 6.0% on npmjs.org
high5 1.0.0 💰
(eventually) spec-compliant html 5 parser
4 versions - Latest release: over 9 years ago - 13 dependent packages - 144 dependent repositories - 70 downloads last month - 25 stars on GitHub - 1 maintainer
react-typeahead-mouseover 0.0.5
React-based typeahead and typeahead-tokenizer with mouseover
4 versions - Latest release: about 9 years ago - 2 dependent packages - 1 dependent repositories - 12 downloads last month - 2 stars on GitHub - 1 maintainer
@liquicode/lib-tokenize 0.1.4
A NodeJS library to tokenize strings
5 versions - Latest release: over 3 years ago - 2 dependent packages - 1 dependent repositories - 9 downloads last month - 0 stars on GitHub - 1 maintainer
simple-token 0.1.0
Create a string representation of an object or primative
2 versions - Latest release: over 9 years ago - 1 dependent package - 4 dependent repositories - 2.67 thousand downloads last month - 1 stars on GitHub - 1 maintainer
jeefo_template 0.0.20
jeefo template
20 versions - Latest release: over 6 years ago - 4 dependent packages - 12 downloads last month - 0 stars on GitHub - 1 maintainer
js-tokeniser 1.1.2
Tokenizes a text from left to right and returns the list of tokens with their types.
6 versions - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 5 downloads last month - 0 stars on GitHub - 1 maintainer
Top 8.2% on npmjs.org
@yozora/tokenizer-math 2.3.1
Tokenizer for processing fenced math block (formulas)
51 versions - Latest release: 4 months ago - 2 dependent packages - 2 dependent repositories - 17 downloads last month - 145 stars on GitHub - 1 maintainer
flukejs 0.0.11
tokenizer, lexer
12 versions - Latest release: about 6 years ago - 2 dependent packages - 3 dependent repositories - 7 downloads last month - 1 stars on GitHub - 1 maintainer
Top 7.5% on npmjs.org
@yozora/tokenizer-inline-math 2.3.1
Tokenizer for processing inline math (formulas)
52 versions - Latest release: 4 months ago - 3 dependent packages - 2 dependent repositories - 18 downloads last month - 145 stars on GitHub - 1 maintainer
Top 8.6% on npmjs.org
@yozora/tokenizer-admonition 2.3.1
Tokenizer for processing admonitions
52 versions - Latest release: 4 months ago - 2 dependent packages - 2 dependent repositories - 16 downloads last month - 145 stars on GitHub - 1 maintainer
@polyfact/vectorizer 1.0.5
Here is a README generated from the code snippet:
6 versions - Latest release: 9 months ago - 51 downloads last month - 2 stars on GitHub - 3 maintainers
mistral-tokenizer-js 1.0.0
JS tokenizer for Mistral-based LLMs
1 version - Latest release: 7 months ago - 1 dependent repositories - 9.77 thousand downloads last month - 13 stars on GitHub - 1 maintainer
@nahanil/zh-tokenizer 0.1.3
Tokenize Chinese texts into words.
1 version - Latest release: almost 5 years ago - 1 dependent package - 1 dependent repositories - 32 downloads last month - 1 maintainer
Top 5.5% on npmjs.org
@jcubic/lips 0.20.3 💰
Simple Scheme Like Lisp in JavaScript
73 versions - Latest release: about 3 years ago - 5 dependent packages - 3 dependent repositories - 105 downloads last month - 387 stars on GitHub - 1 maintainer
@codemayonnaise/react-bootstrap-typeahead 3.4.13
React typeahead with Bootstrap styling
5 versions - Latest release: over 1 year ago - 6 downloads last month - 0 stars on GitHub - 1 maintainer
y-scanner 0.7.9
Simple, but powerful lexical scanner that is a more minimal implementation of X-Scanner
12 versions - Latest release: over 1 year ago - 26 downloads last month - 1 maintainer
mistral-tokenizer-ts 1.2.0
TS tokenizer for Mistral-based LLMs
3 versions - Latest release: 4 months ago - 843 downloads last month - 5 stars on GitHub - 1 maintainer
Top 1.3% on npmjs.org
stream-json 1.8.0
stream-json is the micro-library of Node.js stream components for creating custom JSON processing...
45 versions - Latest release: about 1 year ago - 256 dependent packages - 5,960 dependent repositories - 4.58 million downloads last month - 909 stars on GitHub - 1 maintainer
stream-json-ak 1.7.511
fork of stream-json
3 versions - Latest release: about 1 year ago - 6 downloads last month - 920 stars on GitHub - 1 maintainer
Top 6.0% on npmjs.org
@tokey/core 1.4.0
simple code like tokenizer
6 versions - Latest release: 12 months ago - 8 dependent packages - 24 dependent repositories - 7.76 thousand downloads last month - 6 stars on GitHub - 3 maintainers
@unbundle/ast-parser 1.0.0
ast parser
1 version - Latest release: over 1 year ago - 1 dependent package - 6 downloads last month - 1 stars on GitHub - 1 maintainer
@kessler/tokenize 2.0.0
personal tokenize util
4 versions - Latest release: about 4 years ago - 2 dependent packages - 1 dependent repositories - 6 downloads last month - 3 stars on GitHub - 1 maintainer
jieba-js 1.0.2
jieba-js chinese word segmentation for node in pure javascript.
3 versions - Latest release: about 6 years ago - 1 dependent package - 1 dependent repositories - 57 downloads last month - 2 stars on GitHub - 1 maintainer
@novel-segment/sort-dict-table 1.0.28 💰
Chinese word segmentation 簡繁中文分词模块 以網路小說為樣本 基于 Node.js 的中文分词模块
23 versions - Latest release: about 1 month ago - 1 dependent package - 58 downloads last month - 10 stars on GitHub - 1 maintainer
bredon-plugin-case 1.0.0 💰
Bredon plugin to normalize case
1 version - Latest release: over 6 years ago - 2 dependent packages - 1 dependent repositories - 13 downloads last month - 40 stars on GitHub - 1 maintainer
ipsaquis 1.3.0
A lightly-typescriptified version of jison
6 versions - Latest release: 2 months ago - 6 downloads last month - 0 stars on GitHub - 1 maintainer
@novel-segment/pretty-diff 1.0.25 💰
Chinese word segmentation 簡繁中文分词模块 以網路小說為樣本 基于 Node.js 的中文分词模块
20 versions - Latest release: about 1 month ago - 1 dependent package - 35 downloads last month - 10 stars on GitHub - 1 maintainer
repellenduscum 1.0.2
A lightly-typescriptified version of jison
3 versions - Latest release: 2 months ago - 4 downloads last month - 1 maintainer
source-code-tokenizer 0.1.5
Source code tokenizer powered by vscode
13 versions - Latest release: over 3 years ago - 1 dependent package - 3 dependent repositories - 9 downloads last month - 4 stars on GitHub - 1 maintainer
unicode-tokenizer 1.1.0
Unicode Tokenizer for line breaking.
5 versions - Latest release: over 11 years ago - 2 dependent packages - 3 dependent repositories - 16 downloads last month - 20 stars on GitHub - 1 maintainer
ts-jison-lex 0.0.2
A lightly-typescriptified lexical analyzer generator used by ts-jison
2 versions - Latest release: over 3 years ago - 1 dependent package - 1 dependent repositories - 8 downloads last month - 57 stars on GitHub - 1 maintainer
microxml 1.0.1
Minimal and fast non-validating XML reader.
1 version - Latest release: over 1 year ago - 2 dependent packages - 5 downloads last month - 2 stars on GitHub - 1 maintainer
Top 5.6% on npmjs.org
@tokenizer/token 0.3.0 💰
TypeScript definition for strtok3 token
4 versions - Latest release: almost 3 years ago - 19 dependent packages - 69,519 dependent repositories - 16.8 million downloads last month - 2 stars on GitHub - 1 maintainer
jison-plus 2.0.0
An experimental fork of jison (parser generator with Bison's API) with many changes
3 versions - Latest release: over 8 years ago - 2 dependent packages - 1 dependent repositories - 148 downloads last month - 1 stars on GitHub - 1 maintainer
jsx-to-hyperscript 2.2.1
A CLI command for converting JSX files into standard JS.
17 versions - Latest release: about 1 year ago - 1 dependent repositories - 16 downloads last month - 1 stars on GitHub - 2 maintainers
json-tokenizer 1.1.0
A streaming JSON tokenizer
3 versions - Latest release: almost 7 years ago - 6 dependent packages - 6 dependent repositories - 10 downloads last month - 5 stars on GitHub - 1 maintainer
Top 9.9% on npmjs.org
tokepi 0.0.3
Tokenizer that transforms a string of sentences into an array of white-space separated strings of...
3 versions - Latest release: about 10 years ago - 2 dependent packages - 10 dependent repositories - 438 downloads last month - 2 stars on GitHub - 1 maintainer
Top 8.1% on npmjs.org
@novel-segment/table-synonym 1.0.19 💰
Chinese word segmentation 簡繁中文分词模块 以網路小說為樣本 基于 Node.js 的中文分词模块
19 versions - Latest release: about 1 month ago - 2 dependent packages - 7 dependent repositories - 18.4 thousand downloads last month - 10 stars on GitHub - 1 maintainer
tiny-css-parser 0.10.0 💰
A very small css parser
2 versions - Latest release: over 3 years ago - 1 dependent package - 57 downloads last month - 0 stars on GitHub - 1 maintainer
Top 8.1% on npmjs.org
@novel-segment/table-dict 1.0.22 💰
Chinese word segmentation 簡繁中文分词模块 以網路小說為樣本 基于 Node.js 的中文分词模块
18 versions - Latest release: about 1 month ago - 2 dependent packages - 7 dependent repositories - 18.4 thousand downloads last month - 10 stars on GitHub - 1 maintainer
Top 8.2% on npmjs.org
@novel-segment/table-synonym-pangu 1.0.22 💰
Chinese word segmentation 簡繁中文分词模块 以網路小說為樣本 基于 Node.js 的中文分词模块
18 versions - Latest release: about 1 month ago - 2 dependent packages - 6 dependent repositories - 18.5 thousand downloads last month - 10 stars on GitHub - 1 maintainer
positional-tokenizer 1.0.6
Tokenizes a text using regex rules and returns the tokens with their positions in the text given.
6 versions - Latest release: over 1 year ago - 5 downloads last month - 0 stars on GitHub - 1 maintainer
codepoint-iterator 1.1.1 💰
Fast uint8array to utf-8 codepoint iterator for streams and array buffers by @okikio & @jonathant...
5 versions - Latest release: 3 months ago - 329 downloads last month - 3 stars on GitHub - 1 maintainer
Top 7.6% on npmjs.org
doken 1.0.2
A minimalistic, general purpose tokenizer generator
11 versions - Latest release: almost 4 years ago - 5 dependent packages - 8 dependent repositories - 236 downloads last month - 3 stars on GitHub - 1 maintainer
Top 3.7% on npmjs.org
sentence-tokenizer 1.0.1
Tokenize paragraphs into sentences, and smaller tokens.
10 versions - Latest release: over 5 years ago - 18 dependent packages - 69 dependent repositories - 3.27 thousand downloads last month - 46 stars on GitHub - 1 maintainer
@parsing-kit/lexer 2.3.0-alpha.8
JavaScript library for tokenizing strings with regular expressions
9 versions - Latest release: over 1 year ago - 2 dependent packages - 3 downloads last month - 1 maintainer
tokenstache 1.1.0
tokenizes a string with mustache variables
2 versions - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 0 stars on GitHub - 1 maintainer
react-typeahead-tokenizer 1.1.1
React-based typeahead and typeahead-tokenizer
5 versions - Latest release: almost 7 years ago - 2 dependent packages - 1 dependent repositories - 25 downloads last month - 1 maintainer
bluesocks 0.7.5
Bluesocks is a lightweight lexer for Javascript
18 versions - Latest release: over 6 years ago - 1 dependent package - 1 dependent repositories - 6 downloads last month - 0 stars on GitHub - 1 maintainer
@knod/sbd 2.0.2
Split text into sentence strings or word arrays with Sentence Boundary Detection (SBD). Based on ...
3 versions - Latest release: over 7 years ago - 1 dependent package - 2 dependent repositories - 6 downloads last month - 1 stars on GitHub - 1 maintainer
cljs-parser 0.2.2
Clojurescript parser
8 versions - Latest release: over 10 years ago - 2 dependent packages - 2 dependent repositories - 25 downloads last month - 1 stars on GitHub - 1 maintainer
Top 6.2% on npmjs.org
html-lexer 0.5.0 💰
An HTML5 lexer
7 versions - Latest release: about 1 year ago - 4 dependent packages - 5 dependent repositories - 657 downloads last month - 23 stars on GitHub - 1 maintainer
Top 7.1% on npmjs.org
@novel-segment/table-core-abstract 1.0.23 💰
Chinese word segmentation 簡繁中文分词模块 以網路小說為樣本 基于 Node.js 的中文分词模块
18 versions - Latest release: about 1 month ago - 5 dependent packages - 7 dependent repositories - 18.1 thousand downloads last month - 10 stars on GitHub - 1 maintainer
Top 6.0% on npmjs.org
novel-segment 2.7.118 💰
Chinese word segmentation 簡繁中文分词模块 以網路小說為樣本
238 versions - Latest release: about 1 month ago - 13 dependent packages - 162 dependent repositories - 20.2 thousand downloads last month - 10 stars on GitHub - 1 maintainer
Top 8.1% on npmjs.org
@novel-segment/table-blacklist 1.0.19 💰
Chinese word segmentation 簡繁中文分词模块 以網路小說為樣本 基于 Node.js 的中文分词模块
19 versions - Latest release: about 1 month ago - 2 dependent packages - 7 dependent repositories - 18.1 thousand downloads last month - 10 stars on GitHub - 1 maintainer
Top 6.1% on npmjs.org
nalapa 1.11.0
Collection of NodeJS NLP Library for Bahasa Indonesia.
21 versions - Latest release: about 8 years ago - 9 dependent packages - 16 dependent repositories - 60 downloads last month - 33 stars on GitHub - 1 maintainer
html5-parser 0.1.1
html5 parser for node.js and browsers
2 versions - Latest release: over 9 years ago - 1 dependent package - 1 dependent repositories - 5 downloads last month - 8 stars on GitHub - 1 maintainer
tiny-html-lexer 0.9.1 💰
A tiny HTML5 lexer
10 versions - Latest release: over 3 years ago - 1 dependent package - 2 dependent repositories - 62 downloads last month - 1 stars on GitHub - 1 maintainer
Top 7.6% on npmjs.org
@novel-segment/table-line 1.0.22 💰
原版 node-segment 的格式
18 versions - Latest release: about 1 month ago - 3 dependent packages - 6 dependent repositories - 18.1 thousand downloads last month - 10 stars on GitHub - 1 maintainer
Top 6.3% on npmjs.org
literalizer 0.0.3 💰
Specialized heuristic lexer for JS to identify complex literals
25 versions - Latest release: almost 11 years ago - 6 dependent packages - 12 dependent repositories - 97 downloads last month - 15 stars on GitHub - 1 maintainer
Related Keywords
parser 176 lexer 150 token 84 javascript 70 tokenize 59 ast 51 compiler 49 generator 47 typescript 41 stream 40 nlp 38 react 38 typeahead 35 mistral 31 css 31 chatgpt 30 scanner 30 llama 29 string 29 autocomplete 29 parse 28 tokenization 27 parsing 27 llama2 27 nodejs 27 natural language processing 26 flex 25 text 25 html 25 chinese 25 lex 24 split 24 async 24 NLP 23 word 22 jison 22 llama3 22 gpt4 22 analyzer 21 baichuan 21 chatglm 21 segmentation 21 transfomers 21 tokens 20 css-parser 19 segment 18 react-bootstrap-typeahead 18 text mining 18 中文 18 react-bootstrap-tokenizer 18 react-bootstrap 18 bootstrap-typeahead 18 bootstrap-tokenizer 18 bootstrap 18 regexp 18 chinese segmentation 18 data 18 dict 18 optimizer 18 jieba 18 machine learning 18 language 17 分词 17 中文分词 17 react-component 17 phrases 17 stopword 17 PoS tagging 16 css-value-parser 16 morphological analysis 16 cssinjs 16 css-in-js 16 traverser 16 loader 16 load 16 PanGuSegment 16 hanzi 16 file 16 segmenter 16 dictionary 16 segmentalization 16 pangu 16 novel-segment 16 中文分詞 16 word segmentation 16 sync 16 分詞 16 opencc 16 盘古分词 16 盤古分詞 16 synonym 16 variant 16 novel 16 node-novel 16 node-segment 16 簡繁 15 bredon 15 yacc 14 bison 14 syntax 14