Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

conda-forge.org "tokenizer" keyword

r-hunspell 3.0.2
High-Performance Stemmer, Tokenizer, and Spell Checker for R
5 versions - Latest release: over 1 year ago - 4 dependent packages - 1 dependent repositories - 104 stars on GitHub
sacremoses 0.0.53
Python port of Moses tokenizer, truecaser and normalizer
11 versions - Latest release: about 2 years ago - 2 dependent packages - 33 dependent repositories - 446 stars on GitHub
tokenize-output 0.4.4 💰
Get identifiers, names, paths, URLs and words from the terminal command output.
1 version - Latest release: over 3 years ago - 1 dependent package - 5 stars on GitHub
xontrib-output-search 0.5.3 💰
Get identifiers, paths, URLs and words from the previous command output and use them for the next...
2 versions - Latest release: over 3 years ago - 29 stars on GitHub
r-udpipe 0.8.10
R package for Tokenization, Parts of Speech Tagging, Lemmatization and Dependency Parsing Based o...
4 versions - Latest release: over 1 year ago - 202 stars on GitHub
syntok 1.4.2
Syntok is the successor of an earlier, very similar tool, segtok, but has evolved significantly i...
5 versions - Latest release: over 2 years ago - 168 stars on GitHub
natasha 1.4.0
Solves basic Russian NLP tasks, API for lower level Natasha projects
1 version - Latest release: over 2 years ago - 1,030 stars on GitHub