Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

github.com/ropensci/tokenizers

Fast, Consistent Tokenization of Natural Language Text

Ecosystem
proxy.golang.org
Latest Release
v0.3.0
almost 4 years ago
Versions
8
    Loading...
    Readme
    Loading...
    Links
    Registry proxy.golang.org
    Source Repository
    Docs Documentation
    JSON API View JSON
    CodeMeta codemeta.json
    Package Details
    PURL pkg:golang/github.com/ropensci/tokenizers
    spec
    License Other
    First Release over 10 years ago
    Last Synced about 11 hours ago
    Keywords
    nlp peer-reviewed r r-package rstats text-mining tokenizer
    Repository
    Stars 188 on GitHub
    Forks 24 on GitHub
    Commits 191
    Committers 12
    Avg per Author 15.917
    DDS 0.178
    commits.ecosyste.ms
    repos.ecosyste.ms
    Rankings on proxy.golang.org
    Overall Top 5.6%