gem.coop "tokenization" keyword
View the packages on the gem.coop package registry that are tagged with the "tokenization" keyword.
youtokentome 0.2.1
High performance unsupervised text tokenization for Ruby3 versions - Latest release: over 4 years ago - 15.3 thousand downloads total - 21 stars on GitHub - 1 maintainer
llms-txt-ruby 0.2.0
A Ruby tool for transforming existing markdown documentation into AI-friendly formats following t...5 versions - Latest release: 3 months ago - 1.4 thousand downloads total - 58 stars on GitHub - 1 maintainer
llm-docs-builder 0.12.0
A comprehensive Ruby tool for building and optimizing documentation for Large Language Models. Fe...14 versions - Latest release: about 2 months ago - 2.27 thousand downloads total - 71 stars on GitHub - 1 maintainer
Top 4.9% on gem.coop
41 versions - Latest release: about 1 year ago - 50.1 thousand downloads total - 9 stars on GitHub - 1 maintainer
nlpcloud 1.0.46
NLP Cloud serves high performance pre-trained or custom models for NER, sentiment-analysis, class...41 versions - Latest release: about 1 year ago - 50.1 thousand downloads total - 9 stars on GitHub - 1 maintainer
Top 3.5% on gem.coop
20 versions - Latest release: almost 2 years ago - 83.6 thousand downloads total - 4 stars on GitHub - 1 maintainer
rosette_api 1.27.1
The Rosette Text Analytics Platform uses natural language processing, statistical modeling, and m...20 versions - Latest release: almost 2 years ago - 83.6 thousand downloads total - 4 stars on GitHub - 1 maintainer
Related Keywords
ruby
3
nlp
2
sentiment-analysis
2
ai
2
ai-documentation
2
context-window
2
documentation
2
large-language-models
2
llms
2
llms-txt
2
rag
2
text-processing
2
deduplication
1
text-summarization
1
text-generation
1
text-classification
1
semantic-similarity
1
question-answering
1
paraphrasing
1
entity-extraction
1
language-identification
1
machine-learning
1
morphology
1
named-entity-recognition
1
natural-language-processing
1
text-analytics
1
text-embedding
1
ner
1
machine-translation
1
language-detection
1
keyword-extraction
1
intent-classification
1
grammar-correction
1
embeddings
1
code-generation
1
chatbot
1
ad-generator
1
word-segmentation
1
unsupervised-learning
1
npl
1
byte-pair-encoding
1
bpe
1