Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

Top 1.3% on pypi.org
Top 0.3% downloads on pypi.org
Top 0.2% dependent packages on pypi.org
Top 0.2% dependent repos on pypi.org
Top 4.1% forks on pypi.org
Top 1.0% docker downloads on pypi.org

pypi.org : sacrebleu

Hassle-free computation of shareable, comparable, and reproducible BLEU, chrF, and TER scores

Registry - Source - Documentation - JSON
purl: pkg:pypi/sacrebleu
Keywords: machine translation, evaluation, NLP, natural language processing, computational linguistics
License: Apache-2.0
Latest release: about 2 months ago
First release: over 6 years ago
Dependent packages: 96
Dependent repositories: 4,263
Downloads: 1,797,148 last month
Stars: 983 on GitHub
Forks: 151 on GitHub
Docker dependents: 270
Docker downloads: 1,085,960
Total Commits: 266
Committers: 38
Average commits per author: 7.0
Development Distribution Score (DDS): 0.496
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Last synced: 3 days ago

sonusai 0.16.1
Framework for building deep neural network models for sound, speech, and voice AI
141 versions - Latest release: 18 days ago - 5 dependent packages - 1 dependent repositories - 599 downloads last month - 2 maintainers
Top 6.0% on pypi.org
autotrain-advanced 0.7.96
🤗 AutoTrain Advanced
231 versions - Latest release: 18 days ago - 1 dependent package - 1 dependent repositories - 65.3 thousand downloads last month - 2,505 stars on GitHub - 1 maintainer
autorag 0.1.12
Automatically Evaluate RAG pipelines with your own data. Find optimal structure for new RAG product.
31 versions - Latest release: 19 days ago - 1.22 thousand downloads last month - 515 stars on GitHub - 1 maintainer
Top 4.0% on pypi.org
arize 7.18.0
A helper library to interact with Arize AI APIs
217 versions - Latest release: 20 days ago - 3 dependent packages - 4 dependent repositories - 78.3 thousand downloads last month - 41 stars on GitHub - 1 maintainer
lens-metric 0.2.0
A learnable evaluation metric for text simplification
3 versions - Latest release: 24 days ago - 44 downloads last month - 18 stars on GitHub - 2 maintainers
tf-models-no-deps 2.16.0
TensorFlow Official Models
3 versions - Latest release: 25 days ago - 62 downloads last month - 76,345 stars on GitHub - 1 maintainer
turkish-lm-tuner 0.1.2
Implementation of the Turkish LM Tuner
4 versions - Latest release: 25 days ago - 64 downloads last month - 60 stars on GitHub - 1 maintainer
generate-sequences 0.0.7
A python package to generate from deep learning models
9 versions - Latest release: 27 days ago - 621 downloads last month - 0 stars on GitHub - 1 maintainer
scandeval 12.10.0
Evaluation of pretrained language models on mono- or multilingual language tasks.
118 versions - Latest release: 27 days ago - 1 dependent repositories - 6.38 thousand downloads last month - 31 stars on GitHub - 1 maintainer
bocoel 0.1.2
Bayesian Optimization as a Coverage Tool for Evaluating Large Language Models
7 versions - Latest release: 28 days ago - 193 downloads last month - 257 stars on GitHub - 1 maintainer
Top 6.1% on pypi.org
crfm-helm 0.5.1
Benchmark for language models
10 versions - Latest release: 29 days ago - 1 dependent package - 2 dependent repositories - 1.84 thousand downloads last month - 1,390 stars on GitHub - 2 maintainers
Top 0.1% on pypi.org
transformers 4.40.2
State-of-the-art Machine Learning for JAX, PyTorch and TensorFlow
144 versions - Latest release: 29 days ago - 2,589 dependent packages - 31,800 dependent repositories - 28.1 million downloads last month - 126,450 stars on GitHub - 4 maintainers
Top 0.2% on pypi.org
datasets 2.19.1
HuggingFace community-driven open-source library of datasets
84 versions - Latest release: 29 days ago - 931 dependent packages - 14,962 dependent repositories - 9.95 million downloads last month - 18,550 stars on GitHub - 4 maintainers
Top 0.9% on pypi.org
torchmetrics 1.4.0
PyTorch native Metrics
54 versions - Latest release: 29 days ago - 340 dependent packages - 7,449 dependent repositories - 4.98 million downloads last month - 1,971 stars on GitHub - 2 maintainers
unitxt 1.7.8
Load any mixture of text to text data in one line of code
63 versions - Latest release: about 1 month ago - 1 dependent repositories - 3.85 thousand downloads last month - 13 stars on GitHub - 1 maintainer
Top 8.9% on pypi.org
evals 3.0.1
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
12 versions - Latest release: about 1 month ago - 1 dependent package - 1 dependent repositories - 3.29 thousand downloads last month - 14,102 stars on GitHub - 3 maintainers
Top 1.2% on pypi.org
evaluate 0.4.2
HuggingFace community-driven open-source library of evaluation
15 versions - Latest release: about 1 month ago - 222 dependent packages - 2,474 dependent repositories - 2.7 million downloads last month - 1,762 stars on GitHub - 3 maintainers
bleuscore 0.1.2
A fast bleu score calculator
4 versions - Latest release: about 1 month ago - 601 downloads last month - 0 stars on GitHub - 1 maintainer
llm-blender 0.0.2
LLM-Blender, an innovative ensembling framework to attain consistently superior performance by le...
2 versions - Latest release: about 1 month ago - 412 downloads last month - 789 stars on GitHub - 1 maintainer
Top 6.3% on pypi.org
adapters 0.2.0
A Unified Library for Parameter-Efficient and Modular Transfer Learning
11 versions - Latest release: about 1 month ago - 2 dependent repositories - 13.3 thousand downloads last month - 2,409 stars on GitHub - 3 maintainers
Top 1.0% on pypi.org
tensorflow-model-analysis 0.46.0
A library for analyzing TensorFlow models
57 versions - Latest release: about 1 month ago - 6 dependent packages - 358 dependent repositories - 78.5 thousand downloads last month - 1,241 stars on GitHub - 2 maintainers
Top 2.5% on pypi.org
modelscope 1.14.0
ModelScope: bring the notion of Model-as-a-Service to life.
38 versions - Latest release: about 1 month ago - 25 dependent packages - 14 dependent repositories - 108 thousand downloads last month - 6,146 stars on GitHub - 2 maintainers
prompt2model 0.1.0
A library for distilling models from prompts.
10 versions - Latest release: about 1 month ago - 253 downloads last month - 1,894 stars on GitHub - 1 maintainer
opencompass 0.2.4
A comprehensive toolkit for large model evaluation
11 versions - Latest release: about 1 month ago - 174 downloads last month - 2,659 stars on GitHub - 1 maintainer
zeldarose 0.9.0
Train transformer-based models
16 versions - Latest release: about 2 months ago - 1 dependent repositories - 187 downloads last month - 28 stars on GitHub - 1 maintainer
lmms-eval 0.1.2
A framework for evaluating large multi-modality language models
7 versions - Latest release: about 2 months ago - 560 downloads last month - 0 stars on GitHub - 1 maintainer
llmuses 0.3.0
Eval-Scope: Lightweight LLMs Evaluation Framework
8 versions - Latest release: about 2 months ago - 1 dependent package - 466 downloads last month - 70 stars on GitHub - 1 maintainer
Top 3.7% on pypi.org
lit-nlp 1.1.1
🔥LIT: The Learning Interpretability Tool
16 versions - Latest release: about 2 months ago - 2 dependent packages - 6 dependent repositories - 4.59 thousand downloads last month - 3,386 stars on GitHub - 4 maintainers
weblinx 0.2.4
The official weblinx library
9 versions - Latest release: 2 months ago - 498 downloads last month - 94 stars on GitHub - 2 maintainers
Top 4.9% on pypi.org
fairseq2 0.2.1
FAIR Sequence Modeling Toolkit
4 versions - Latest release: 2 months ago - 2 dependent packages - 35 dependent repositories - 13.9 thousand downloads last month - 494 stars on GitHub - 1 maintainer
pureml-llm 0.1.1
1 version - Latest release: 2 months ago - 24 downloads last month - 2 maintainers
lighteval 0.3.0
A lightweight and configurable evaluation package
8 versions - Latest release: 2 months ago - 2.07 thousand downloads last month - 299 stars on GitHub - 3 maintainers
testverse 0.0.14 removed
Test version of evalverse
13 versions - Latest release: 2 months ago - 535 downloads last month - 1 maintainer
Top 1.0% on pypi.org
tf-models-nightly 2.17.0.dev20240323
TensorFlow Official Models
1,376 versions - Latest release: 2 months ago - 2 dependent packages - 120 dependent repositories - 466 thousand downloads last month - 76,345 stars on GitHub - 1 maintainer
Top 2.7% on pypi.org
opennmt-py 3.5.1
A python implementation of OpenNMT
34 versions - Latest release: 3 months ago - 3 dependent packages - 11 dependent repositories - 12.7 thousand downloads last month - 6,547 stars on GitHub - 3 maintainers
Top 3.8% on pypi.org
s3prl 0.4.15
Self-Supervised Speech Pre-training and Representation Learning Toolkit
25 versions - Latest release: 3 months ago - 1 dependent package - 10 dependent repositories - 5.32 thousand downloads last month - 2,094 stars on GitHub - 1 maintainer
Top 1.5% on pypi.org
lm-eval 0.4.2
A framework for evaluating language models
6 versions - Latest release: 3 months ago - 15 dependent packages - 252 dependent repositories - 198 thousand downloads last month - 5,431 stars on GitHub - 4 maintainers
mammoth-nlp 0.1.1
Massively Multilingual Modular Open Translation @ Helsinki
2 versions - Latest release: 3 months ago - 42 downloads last month - 14 stars on GitHub - 1 maintainer
Top 0.6% on pypi.org
tf-models-official 2.16.0
TensorFlow Official Models
41 versions - Latest release: 3 months ago - 18 dependent packages - 436 dependent repositories - 191 thousand downloads last month - 76,345 stars on GitHub - 3 maintainers
nm-transformers 1.7.0.43401
State-of-the-art Machine Learning for JAX, PyTorch and TensorFlow
4 versions - Latest release: 3 months ago - 3 dependent packages - 1 dependent repositories - 177 downloads last month - 9 stars on GitHub - 1 maintainer
Top 3.5% on pypi.org
unbabel-comet 2.2.2
High-quality Machine Translation Evaluation
33 versions - Latest release: 3 months ago - 4 dependent packages - 45 dependent repositories - 23 thousand downloads last month - 401 stars on GitHub - 2 maintainers
nm-transformers-nightly 1.7.0.20240304
State-of-the-art Machine Learning for JAX, PyTorch and TensorFlow
37 versions - Latest release: 3 months ago - 3 dependent packages - 228 downloads last month - 9 stars on GitHub - 1 maintainer
geniusrise-text 0.1.13
Text bolts for geniusrise
14 versions - Latest release: 3 months ago - 86 downloads last month - 2 stars on GitHub - 1 maintainer
localcat 0.0.10
Fine-tune Large Language Models locally.
6 versions - Latest release: 3 months ago - 38 downloads last month - 0 stars on GitHub - 1 maintainer
lm-polygraph 0.0.1.dev1
Uncertainty Estimation Toolkit for Transformer Language Models
2 versions - Latest release: 3 months ago - 39 downloads last month - 66 stars on GitHub - 2 maintainers
h2ogpt 0.2.0
Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports...
2 versions - Latest release: 3 months ago - 36 downloads last month - 10,805 stars on GitHub - 1 maintainer
Top 1.6% on pypi.org
nemo-toolkit 1.23.0
NeMo - a toolkit for Conversational AI
70 versions - Latest release: 3 months ago - 4 dependent packages - 27 dependent repositories - 49 thousand downloads last month - 10,121 stars on GitHub - 2 maintainers
vec2text 0.0.12
convert embedding vectors back to text
11 versions - Latest release: 3 months ago - 946 downloads last month - 1 maintainer
geniusrise-vision 0.1.5
Huggingface bolts for geniusrise
8 versions - Latest release: 4 months ago - 63 downloads last month - 3 stars on GitHub - 1 maintainer
Top 6.7% on pypi.org
joeynmt 2.3.0
Minimalist NMT for educational purposes
14 versions - Latest release: 4 months ago - 8 dependent repositories - 202 downloads last month - 657 stars on GitHub - 3 maintainers
ragchain 0.2.6
Build advanced RAG workflows with LLM, compatible with Langchain
13 versions - Latest release: 5 months ago - 153 downloads last month - 242 stars on GitHub - 1 maintainer
nlpia2 0.0.42
Natural language processing utilities and examples for the book Natural Language Processing in Ac...
24 versions - Latest release: 5 months ago - 1 dependent repositories - 108 downloads last month - 1 stars on GitLab.com - 3 maintainers
sevals 0.0.3
A framework for evaluating language models
4 versions - Latest release: 5 months ago - 25 downloads last month - 0 stars on GitHub - 1 maintainer
mbr 0.2.0
Minimum Bayes risk decoding for Hugging Face Transformers
2 versions - Latest release: 5 months ago - 1 dependent repositories - 32 downloads last month - 46 stars on GitHub - 1 maintainer
adaptor 0.2.3
Adaptor: Objective-centric Adaptation Framework for Language Models.
11 versions - Latest release: 6 months ago - 1 dependent repositories - 113 downloads last month - 25 stars on GitHub - 1 maintainer
guardrails-ai-unbabel-comet 2.2.1
High-quality Machine Translation Evaluation
1 version - Latest release: 6 months ago - 1 dependent package - 641 downloads last month - 401 stars on GitHub - 1 maintainer
simuleval 1.1.4
SimulEval: A Flexible Toolkit for Automated Machine Translation Evaluation
8 versions - Latest release: 6 months ago - 1 dependent repositories - 3.33 thousand downloads last month - 87 stars on GitHub - 2 maintainers
Top 7.9% on pypi.org
flagai 1.8.4
FlagAI aims to help researchers and developers to freely train and test large-scale models for NL...
46 versions - Latest release: 6 months ago - 1 dependent repositories - 446 downloads last month - 3,767 stars on GitHub - 1 maintainer
fairseq2-patch 0.1.1
FAIR Sequence Modeling Toolkit
1 version - Latest release: 7 months ago - 9 downloads last month - 494 stars on GitHub - 1 maintainer
gem-metrics-fork 0.1.dev0
GEM Challenge metrics
1 version - Latest release: 7 months ago - 1 dependent package - 1 dependent repositories - 36 downloads last month - 1 maintainer
jrvc 0.0.1.dev14
Libraries for RVC inference
10 versions - Latest release: 7 months ago - 245 downloads last month - 1 maintainer
pdexplorer 0.0.32
A Stata emulator for Python/pandas
30 versions - Latest release: 7 months ago - 75 downloads last month - 6 stars on GitHub - 1 maintainer
kogitune 0.1
The Kogitune 🦊 LLM Project
1 version - Latest release: 8 months ago - 9 downloads last month - 1 stars on GitHub - 1 maintainer
geniusrise-huggingface 0.4.9
Huggingface bolts for geniusrise
13 versions - Latest release: 9 months ago - 114 downloads last month - 1 stars on GitHub - 1 maintainer
sentia 1.0.5
A text generation model combining multiple neural network architectures
13 versions - Latest release: 9 months ago - 83 downloads last month - 1 maintainer
aigc-evals 0.0.3
aigc_evals
3 versions - Latest release: 9 months ago - 16 downloads last month - 11 stars on GitHub - 1 maintainer
luna-nlg 1.0.0
Source code for the LUNA project
1 version - Latest release: 9 months ago - 13 downloads last month - 1 stars on GitHub - 1 maintainer
transcode 1.2.0
Packing transcoder model
3 versions - Latest release: 9 months ago - 2 dependent repositories - 41 downloads last month - 1 stars on GitHub - 1 maintainer
dashai 0.0.14
DashAI: a graphical toolbox for training, evaluating and deploying state-of-the-art AI models.
10 versions - Latest release: 10 months ago - 1 dependent package - 102 downloads last month - 38 stars on GitHub - 1 maintainer
evals-nightly 1.0.3.dev20230807
67 versions - Latest release: 10 months ago - 1.32 thousand downloads last month - 3 maintainers
Top 3.5% on pypi.org
opennmt-tf 2.32.0
Neural machine translation and sequence learning using TensorFlow
101 versions - Latest release: 10 months ago - 1 dependent package - 43 dependent repositories - 9.14 thousand downloads last month - 1,440 stars on GitHub - 3 maintainers
simpeval 0.1.0
Evaluation of text simplification with TUPA and SAMSA
1 version - Latest release: 10 months ago - 17 downloads last month - 0 stars on GitHub - 1 maintainer
Top 7.9% on pypi.org
jury 2.2.4
Evaluation toolkit for neural language generation.
23 versions - Latest release: 12 months ago - 1 dependent package - 2 dependent repositories - 608 downloads last month - 178 stars on GitHub - 1 maintainer
kogito 0.6.2
A Python NLP Commonsense Knowledge Inference Toolkit
27 versions - Latest release: 12 months ago - 2 dependent repositories - 275 downloads last month - 59 stars on GitHub - 1 maintainer
Top 9.6% on pypi.org
string2string 0.0.150
String-to-String Algorithms for Natural Language Processing
11 versions - Latest release: about 1 year ago - 1 dependent repositories - 3.19 thousand downloads last month - 499 stars on GitHub - 1 maintainer
mw-adapter-transformers 3.2.1
A friendly fork of HuggingFace's Transformers, adding Adapters to PyTorch language models
3 versions - Latest release: about 1 year ago - 38 downloads last month - 2,409 stars on GitHub - 3 maintainers
alexa-teacher-models 1.0.1
Alexa Teacher Models
1 version - Latest release: about 1 year ago - 17 downloads last month - 1 maintainer
Top 2.2% on pypi.org
adapter-transformers 3.2.1
A friendly fork of HuggingFace's Transformers, adding Adapters to PyTorch language models
17 versions - Latest release: about 1 year ago - 2 dependent packages - 49 dependent repositories - 126 thousand downloads last month - 2,409 stars on GitHub - 3 maintainers
Top 1.8% on pypi.org
t5 0.9.4
Text-to-text transfer transformer
30 versions - Latest release: about 1 year ago - 1 dependent package - 163 dependent repositories - 41.8 thousand downloads last month - 5,931 stars on GitHub - 2 maintainers
transformers-machinify 4.27.0.dev0
State-of-the-art Machine Learning for JAX, PyTorch and TensorFlow
1 version - Latest release: about 1 year ago - 1 dependent package - 36 downloads last month - 126,276 stars on GitHub - 2 maintainers
Top 2.8% on pypi.org
paddlespeech 1.4.1
Speech tools and models based on Paddlepaddle
34 versions - Latest release: about 1 year ago - 1 dependent package - 69 dependent repositories - 5.15 thousand downloads last month - 10,329 stars on GitHub - 1 maintainer
Top 8.9% on pypi.org
explainaboard 0.12.7
Explainable Leaderboards for Natural Language Processing
87 versions - Latest release: about 1 year ago - 2 dependent packages - 1 dependent repositories - 656 downloads last month - 360 stars on GitHub - 2 maintainers
Top 5.9% on pypi.org
sockeye 3.1.34
Sequence-to-Sequence framework for Neural Machine Translation
84 versions - Latest release: over 1 year ago - 4 dependent repositories - 1.5 thousand downloads last month - 1,207 stars on GitHub - 2 maintainers
convlab 3.0.1
An Open-source Dialog System Toolkit
7 versions - Latest release: over 1 year ago - 1 dependent repositories - 94 downloads last month - 98 stars on GitHub - 1 maintainer
ai2-catwalk 0.2.2
A library for evaluating language models.
2 versions - Latest release: over 1 year ago - 176 downloads last month - 134 stars on GitHub - 2 maintainers
deepa2 0.1.16
Cast NLP data as multiangular DeepA2 datasets and integrate these in training pipeline
17 versions - Latest release: over 1 year ago - 1 dependent repositories - 179 downloads last month - 2 stars on GitHub - 1 maintainer
subtitle-edit-rate 0.2.0
SubER: a metric for automatic evaluation of subtitle quality
2 versions - Latest release: over 1 year ago - 1 dependent repositories - 53 downloads last month - 16 stars on GitHub - 1 maintainer
reword 0.1.0
Reorder word in English sentence to follow correct grammar
1 version - Latest release: over 1 year ago - 15 downloads last month - 1 maintainer
compromise-marian 0.1.2
Marian model but with two decoders
2 versions - Latest release: over 1 year ago - 25 downloads last month - 0 stars on GitHub - 1 maintainer
Top 9.2% on pypi.org
datalabs 0.4.15
Datalabs
54 versions - Latest release: over 1 year ago - 3 dependent packages - 2 dependent repositories - 392 downloads last month - 125 stars on GitHub - 2 maintainers
narg2p 0.1.3
Non AutoRegressive Grapheme to Phoneme conversion Toolkit
11 versions - Latest release: over 1 year ago - 401 downloads last month - 1 maintainer
Top 5.6% on pypi.org
transformers4token 4.20.0 removed
State-of-the-art Machine Learning for JAX, PyTorch and TensorFlow
2 versions - Latest release: over 1 year ago
cody-adapter-transformers 3.0.1
A friendly fork of HuggingFace's Transformers, adding Adapters to PyTorch language models
1 version - Latest release: over 1 year ago - 26 downloads last month - 2,409 stars on GitHub - 1 maintainer
rtg 0.7.2
Reader Translator Generator(RTG), a Neural Machine Translator(NMT) toolkit based on Pytorch
11 versions - Latest release: over 1 year ago - 2 dependent repositories - 84 downloads last month - 28 stars on GitHub - 1 maintainer
classy-core 0.3.2
A powerful tool to train and use your classification models.
62 versions - Latest release: over 1 year ago - 1 dependent repositories - 517 downloads last month - 83 stars on GitHub - 1 maintainer
Top 1.2% on pypi.org
espnet 0.10.6
ESPnet: end-to-end speech processing toolkit
34 versions - Latest release: over 2 years ago - 6 dependent packages - 217 dependent repositories - 40.9 thousand downloads last month - 7,825 stars on GitHub - 4 maintainers