npmjs.org : intl-segmenter
A high-performance wrapper around `Intl.Segmenter` for efficient text segmentation. This class resolves memory handling issues seen with large strings and can enhance performance by 50-500x. Only ~70 loc (with comments) and no dependencies.
Registry
-
Source
- JSON
purl: pkg:npm/intl-segmenter
Keywords:
ansi
, ascii
, character
, characters
, chunk
, chunks
, emoji
, emojis
, graphemes
, intl
, segment
, segmentation
, segmenter
, sentences
, split
, string
, strings
, terminal
, text
, tokenization
, tokenize
, unicode
, utf-8
, utf16
, utf32
, utf8
, words
, intl-segmenter
, processing
, splitter
License: MIT
Latest release: 3 months ago
First release: 3 months ago
Downloads: 101 last month
Stars: 10 on GitHub
Forks: 1 on GitHub
See more repository details: repos.ecosyste.ms
Funding links: https://github.com/sponsors/jonschlinkert
Last synced: 10 days ago