Top 0.2% dependent packages on proxy.golang.org
Top 0.2% dependent repos on proxy.golang.org
Top 5.4% forks on proxy.golang.org
Top 0.1% docker downloads on proxy.golang.org
proxy.golang.org : github.com/blevesearch/segment
Package segment is a library for performing Unicode Text Segmentation as described in Unicode Standard Annex #29 http://www.unicode.org/reports/tr29/ Currently only segmentation at Word Boundaries is supported. The functionality is exposed in two ways: 1. You can use a bufio.Scanner with the SplitWords implementation of SplitFunc. The SplitWords function will identify the appropriate word boundaries in the input text and the Scanner will return tokens at the appropriate place. 2. Sometimes you would also like information returned about the type of token. To do this we have introduce a new type named Segmenter. It works just like Scanner but additionally a token type is returned.
Registry
-
Source
- Documentation
- JSON
purl: pkg:golang/github.com/blevesearch/segment
License: Apache-2.0
Latest release: over 2 years ago
First release: over 8 years ago
Namespace: github.com/blevesearch
Dependent packages: 557
Dependent repositories: 1,358
Stars: 75 on GitHub
Forks: 16 on GitHub
Docker dependents: 421
Docker downloads: 5,498,979,086
See more repository details: repos.ecosyste.ms
Last synced: about 7 hours ago