Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "evaluation" keyword

zenoml 0.6.4
Interactive Evaluation Framework for Machine Learning
51 versions - Latest release: 10 months ago - 1 dependent package - 1 dependent repositories - 164 downloads last month - 209 stars on GitHub - 1 maintainer
zenoml-text-classification 0.0.2
Text Classification for Zeno
2 versions - Latest release: over 1 year ago - 1 dependent repositories - 9 downloads last month - 209 stars on GitHub - 1 maintainer
Top 5.2% on pypi.org
keras-metrics 1.1.0
Metrics for Keras model evaluation
9 versions - Latest release: about 5 years ago - 41 dependent repositories - 1.83 thousand downloads last month - 166 stars on GitHub - 1 maintainer
Top 3.3% on pypi.org
pytrec-eval 0.5
Provides Python bindings for popular Information Retrieval measures implemented within trec_eval.
3 versions - Latest release: over 3 years ago - 9 dependent packages - 36 dependent repositories - 44.9 thousand downloads last month - 254 stars on GitHub - 1 maintainer
configspacex 0.4.12
Creation and manipulation of parameter configuration spaces for automated algorithm configuration...
1 version - Latest release: about 4 years ago - 11 downloads last month - 0 stars on GitHub - 1 maintainer
bob.fusion.base 0.1.5
Score fusion in biometric and pad experiments
13 versions - Latest release: 12 months ago - 71 downloads last month - 1 maintainer
abed 0.1.3
A command line tool for easily managing benchmark experiments
7 versions - Latest release: over 2 years ago - 72 downloads last month - 4 stars on GitHub - 1 maintainer
semevalplatform 0.0.10
Semantic Evaluation Platform
14 versions - Latest release: over 1 year ago - 1 dependent repositories - 54 downloads last month - 0 stars on GitHub - 1 maintainer
bob.paper.tifs2018-dsu 1.0.2
Tools to reproduce the paper "Heterogeneous Face Recognition Using Domain Specific Units"
2 versions - Latest release: over 5 years ago - 11 downloads last month - 1 maintainer
bob.ip.mtcnn 1.0.3
Face detection and landmark extraction using MTCNN pretrained model
5 versions - Latest release: over 4 years ago - 15 downloads last month - 1 maintainer
Top 1.3% on pypi.org
sacrebleu 2.4.2
Hassle-free computation of shareable, comparable, and reproducible BLEU, chrF, and TER scores
69 versions - Latest release: about 2 months ago - 96 dependent packages - 4,263 dependent repositories - 1.8 million downloads last month - 983 stars on GitHub - 3 maintainers
indic-eval
A package to make LLM evaluation easier
1 version - 21 stars on GitHub
athina 1.2.19
Python SDK to configure and run evaluations for your LLM-based application
57 versions - Latest release: 16 days ago - 2.38 thousand downloads last month - 139 stars on GitHub - 1 maintainer
omega-index-py3 0.3.2
Omega Index for evaluation of overlapping community structure
3 versions - Latest release: almost 3 years ago - 1 dependent package - 11 dependent repositories - 194 downloads last month - 1 maintainer
labpy 0.0.4
labpy - a python laboratory (automation) environment
2 versions - Latest release: over 5 years ago - 1 dependent repositories - 16 downloads last month - 1 maintainer
quotientai 0.0.4
CLI for evaluating large language models with Quotient
4 versions - Latest release: about 1 month ago - 65 downloads last month - 1 maintainer
evo-1 1.1.2
Python package for the evaluation of odometry and SLAM
1 version - Latest release: over 5 years ago - 2 dependent repositories - 21 downloads last month - 2 stars on GitHub - 1 maintainer
prediction-evaluation 0.0.1
evaluation of prediction of binary, multiclass and regression
2 versions - Latest release: over 5 years ago - 1 dependent repositories - 21 downloads last month - 1 maintainer
flare22-dsc-nsd-test 0.0.2
FLARE22_DSC_NSD_Evaluation
2 versions - Latest release: almost 2 years ago - 13 downloads last month - 55 stars on GitHub - 1 maintainer
assembled 0.0.4
Efficiently Benchmarking Ensembles in AutoML
4 versions - Latest release: over 1 year ago - 2 dependent repositories - 21 downloads last month - 3 stars on GitHub - 1 maintainer
Top 3.1% on pypi.org
langsmith 0.1.59
Client library to connect to the LangSmith LLM Tracing and Evaluation Platform.
175 versions - Latest release: 17 days ago - 86 dependent packages - 2,234 dependent repositories - 8.12 million downloads last month - 217 stars on GitHub - 1 maintainer
audio-degrader 1.3.1
Tool to introduce controlled degradations to audio
13 versions - Latest release: over 3 years ago - 123 downloads last month - 50 stars on GitHub - 1 maintainer
Top 4.6% on pypi.org
avalanche-lib 0.5.0 💰
Avalanche: a Comprehensive Framework for Continual Learning Research
7 versions - Latest release: 3 months ago - 2 dependent packages - 10 dependent repositories - 937 downloads last month - 1,699 stars on GitHub - 1 maintainer
Top 7.2% on pypi.org
neleval 3.1.1
Command-line evaluation tools for named entity linking and (cross-document) coreference resolution
6 versions - Latest release: over 4 years ago - 2 dependent packages - 5 dependent repositories - 367 downloads last month - 115 stars on GitHub - 1 maintainer
Top 9.7% on pypi.org
uptrain 0.7.1
UpTrain - tool to evaluate LLM applications on aspects like factual accuracy, response quality, r...
49 versions - Latest release: 19 days ago - 2 dependent packages - 1 dependent repositories - 4.53 thousand downloads last month - 2,045 stars on GitHub - 2 maintainers
llama-index-callbacks-uptrain 0.2.0
UpTrain Callback for performing evaluations on the LlamaIndex pipeline
3 versions - Latest release: 19 days ago - 217 downloads last month - 2,045 stars on GitHub - 1 maintainer
Top 8.9% on pypi.org
codebleu 0.6.1
Unofficial CodeBLEU implementation that supports Linux, MacOS and Windows available on PyPI.
14 versions - Latest release: 18 days ago - 3 dependent repositories - 1.57 thousand downloads last month - 38 stars on GitHub - 1 maintainer
fast-eval 1.1.0
Simple tool to provide automation to assessment processes.
22 versions - Latest release: about 3 years ago - 1 dependent repositories - 78 downloads last month - 0 stars on GitHub - 1 maintainer
bob.ip.dlib 1.0.9
Bob interface for dlib functions
9 versions - Latest release: over 3 years ago - 39 downloads last month - 1 maintainer
llmuses 0.3.0
Eval-Scope: Lightweight LLMs Evaluation Framework
8 versions - Latest release: about 2 months ago - 1 dependent package - 466 downloads last month - 70 stars on GitHub - 1 maintainer
tno.sdg.tabular.eval.utility-metrics 0.3.0
Utility metrics for tabular data
1 version - Latest release: 3 months ago - 13 downloads last month - 2 stars on GitHub - 1 maintainer
ersatz 1.0.0
Simple sentence segmentation toolkit for segmenting and scoring
2 versions - Latest release: almost 3 years ago - 1 dependent repositories - 85 downloads last month - 34 stars on GitHub - 2 maintainers
Top 7.7% on pypi.org
insight 1.0
A python library for monitoring, comparing and extracting insights from data.
23 versions - Latest release: 2 months ago - 5 dependent repositories - 6.79 thousand downloads last month - 12 stars on GitHub - 1 maintainer
Top 1.1% on pypi.org
configspace 0.7.2
Creation and manipulation of parameter configuration spaces for automated algorithm configuration...
43 versions - Latest release: 11 months ago - 31 dependent packages - 56 dependent repositories - 87.2 thousand downloads last month - 186 stars on GitHub - 2 maintainers
replay-rec 0.16.0
RecSys Library
17 versions - Latest release: 3 months ago - 1 dependent package - 1 dependent repositories - 6.17 thousand downloads last month - 127 stars on GitHub - 1 maintainer
evalipy 0.0.5
Evalipy is a framework for evaluating & comparing machine learning models.
2 versions - Latest release: over 1 year ago - 15 downloads last month - 7 stars on GitHub - 1 maintainer
audmetric 1.2.1
Evaluate machine-learning models
11 versions - Latest release: 3 months ago - 2 dependent packages - 2 dependent repositories - 1.08 thousand downloads last month - 1 stars on GitHub - 1 maintainer
Top 6.7% on pypi.org
agenta 0.14.8
The SDK for agenta is an open-source LLMOps platform.
131 versions - Latest release: 20 days ago - 2 dependent repositories - 4.78 thousand downloads last month - 575 stars on GitHub - 1 maintainer
palladio 2.0.4rc1
ParALleL frAmework for moDel selectIOn
6 versions - Latest release: almost 7 years ago - 1 dependent repositories - 36 downloads last month - 8 stars on GitHub - 2 maintainers
Top 8.2% on pypi.org
langfuse 2.32.0
A client library for accessing langfuse
325 versions - Latest release: 16 days ago - 17 dependent packages - 1 dependent repositories - 267 thousand downloads last month - 2,823 stars on GitHub - 2 maintainers
ir-evaluation-py 1.0.0
This library was created in order to evaluate the effectiveness of any kind of algorithm used in ...
1 version - Latest release: about 4 years ago - 1 dependent repositories - 23 downloads last month - 15 stars on GitHub - 1 maintainer
sci-annot-eval 0.0.9
The evaluation component of the sci-annot framework
5 versions - Latest release: 10 months ago - 1 dependent repositories - 20 downloads last month - 0 stars on GitHub - 1 maintainer
django-estimators 0.2.1
A django model to persist and track machine learning models
3 versions - Latest release: over 7 years ago - 6 dependent repositories - 9 downloads last month - 49 stars on GitHub - 1 maintainer
python-adc-eval 0.2.0
ADC Evaluation Library
8 versions - Latest release: about 1 month ago - 41 downloads last month - 1 stars on GitHub - 1 maintainer
autorag 0.1.12
Automatically Evaluate RAG pipelines with your own data. Find optimal structure for new RAG product.
30 versions - Latest release: 17 days ago - 1.05 thousand downloads last month - 515 stars on GitHub - 1 maintainer
tmtoolkit 0.12.0
Text Mining and Topic Modeling Toolkit
35 versions - Latest release: about 1 year ago - 2 dependent packages - 10 dependent repositories - 2.12 thousand downloads last month - 12 stars on GitHub - 2 maintainers
Top 1.8% on pypi.org
motmetrics 1.4.0
Metrics for multiple object tracker benchmarking.
9 versions - Latest release: over 1 year ago - 13 dependent packages - 398 dependent repositories - 152 thousand downloads last month - 1,335 stars on GitHub - 1 maintainer
Top 3.5% on pypi.org
rliable 1.0.8
rliable: Reliable evaluation on reinforcement learning and machine learning benchmarks.
9 versions - Latest release: almost 2 years ago - 6 dependent packages - 15 dependent repositories - 6.46 thousand downloads last month - 708 stars on GitHub - 1 maintainer
topic999 1.0.1.dev1
Topic Model User Evaluation
1 version - Latest release: almost 7 years ago - 1 dependent repositories - 12 downloads last month - 1 maintainer
tsml-eval 0.3.0
A package for benchmarking time series machine learning tools.
7 versions - Latest release: about 1 month ago - 235 downloads last month - 20 stars on GitHub - 1 maintainer
drift-anomaly-evaluator 0.0.1
An initial evaluation of drift anomaly detection models
1 version - Latest release: about 2 years ago - 1 dependent repositories - 10 downloads last month - 1 maintainer
pyntcireval 0.0.3
Python version of NTCIREVAL
2 versions - Latest release: almost 5 years ago - 1 dependent repositories - 24 downloads last month - 22 stars on GitHub - 1 maintainer
modeleval 0.1.7
A Python 3 library for a easier machine learning model evaluation
8 versions - Latest release: about 5 years ago - 1 dependent repositories - 31 downloads last month - 21 stars on GitHub - 1 maintainer
Top 1.8% on pypi.org
simpleeval 0.9.13 💰
A simple, safe single expression evaluator library.
18 versions - Latest release: over 1 year ago - 59 dependent packages - 290 dependent repositories - 1.41 million downloads last month - 428 stars on GitHub - 1 maintainer
django-access-tastypie 0.1.0b2
Django-Access-Tastypie - the application introducing authorization module for the Tastypie packag...
5 versions - Latest release: 4 months ago - 1 dependent repositories - 83 downloads last month - 3 stars on GitHub - 1 maintainer
evaldet 0.4.0
Evaluation for Detection and Tracking
13 versions - Latest release: 12 months ago - 1 dependent repositories - 68 downloads last month - 2 stars on GitHub - 1 maintainer
opencompass 0.2.4
A comprehensive toolkit for large model evaluation
11 versions - Latest release: about 1 month ago - 174 downloads last month - 2,659 stars on GitHub - 1 maintainer
evaluators 1.0.3
Various scene understanding and perception evaluation metrics.
3 versions - Latest release: about 1 year ago - 76 downloads last month - 29,005 stars on GitHub - 1 maintainer
b3score 0.2
BCUBED extrinsic clustering metric
2 versions - Latest release: almost 8 years ago - 1 dependent repositories - 19 downloads last month - 4 stars on GitHub - 1 maintainer
boolexp 0.1
Safe boolean expression evaluator
1 version - Latest release: over 10 years ago - 5 dependent repositories - 33 downloads last month - 1 maintainer
antgo 0.1.24
machine learning experiment platform
46 versions - Latest release: 11 months ago - 1 dependent repositories - 112 downloads last month - 16 stars on GitHub - 1 maintainer
clusters-features 1.0.3
The Clusters-Features package allows data science users to compute high-level linear algebra oper...
2 versions - Latest release: almost 3 years ago - 46 downloads last month - 28 stars on GitHub - 1 maintainer
evalpm 0.1.2
A framework for creating and evaluating immission models for Particulate Matter
3 versions - Latest release: 8 months ago - 11 downloads last month - 2 stars on GitHub - 1 maintainer
evalmate 0.3.0
Evalmate is a set of tools for evaluating audio related machine learning tasks.
3 versions - Latest release: over 5 years ago - 1 dependent repositories - 22 downloads last month - 3 stars on GitHub - 1 maintainer
bob.thesis.tiago 1.0.1
Tools to reproduce the experiments of the Ph.D. thesis from Tiago de Freitas Pereira
2 versions - Latest release: over 5 years ago - 13 downloads last month - 1 maintainer
sprint-toolkit 0.0.3
SPRINT: A Unified Toolkit for Evaluating and Demystifying Zero-shot Neural Sparse Retrieval
3 versions - Latest release: 12 months ago - 17 downloads last month - 35 stars on GitHub - 1 maintainer
pycond 2020.10.10
Lightweight Condition Parsing and Building of Evaluation Expressions
31 versions - Latest release: over 3 years ago - 2 dependent packages - 3 dependent repositories - 2.33 thousand downloads last month - 24 stars on GitHub - 1 maintainer
chainforge 0.2.6
A Visual Programming Environment for Prompt Engineering
89 versions - Latest release: 9 months ago - 814 downloads last month - 2,049 stars on GitHub - 1 maintainer
kolena 1.18.0
Client for Kolena's machine learning testing platform.
67 versions - Latest release: 19 days ago - 1 dependent repositories - 7.14 thousand downloads last month - 38 stars on GitHub - 1 maintainer
kolena-client 1.18.0
Client for Kolena's machine learning testing platform.
72 versions - Latest release: 19 days ago - 1.43 thousand downloads last month - 38 stars on GitHub - 1 maintainer
deepvision-toolkit 0.1.6
PyTorch and TensorFlow/Keras image models with automatic weight conversions and equal API/impleme...
5 versions - Latest release: about 1 year ago - 14 downloads last month - 30 stars on GitHub - 1 maintainer
lara-django 0.2.6
LARA-django is a python django project of the Lab Automation Suite LARA - (lara.uni-greifswald.de...
1 version - Latest release: about 4 years ago - 1 dependent repositories - 18 downloads last month - 1 stars on GitLab.com - 1 maintainer
Top 5.6% on pypi.org
prdc 0.2
Compute precision, recall, density, and coverage metrics for two sets of vectors.
1 version - Latest release: over 4 years ago - 2 dependent packages - 17 dependent repositories - 13.9 thousand downloads last month - 234 stars on GitHub - 1 maintainer
Top 6.6% on pypi.org
fore 0.1.7
fore ai packages
10 versions - Latest release: 2 months ago - 4 dependent repositories - 82 thousand downloads last month - 13 stars on GitHub - 3 maintainers
process-tracing 0.1.0a1
ptrace based process tracing utilities for python
11 versions - Latest release: 9 months ago - 1 dependent repositories - 82 downloads last month - 2 stars on GitHub - 1 maintainer
icdar21-mapseg-eval 1.0.4
Evaluation tools for ICDAR21 Competition on Historical Map Segmentation (MapSeg).
5 versions - Latest release: about 3 years ago - 1 dependent repositories - 13 downloads last month - 2 stars on GitHub - 1 maintainer
json-criteria 0.2.0
Python library designed for evaluating data against serializable JSON criteria
6 versions - Latest release: about 1 month ago - 131 downloads last month - 2 stars on GitHub - 1 maintainer
fiddler-auditor 0.0.5
Auditing large language models made easy.
12 versions - Latest release: 7 months ago - 1 dependent repositories - 834 downloads last month - 142 stars on GitHub - 1 maintainer
pyieoe 0.1.1
pyIEOE: a Python package to facilitate interpretable OPE evaluation
2 versions - Latest release: almost 3 years ago - 1 dependent package - 4 dependent repositories - 358 downloads last month - 29 stars on GitHub - 1 maintainer
Top 9.9% on pypi.org
django-access 0.1.2b2
Django-Access - the application introducing dynamic evaluation-based instance-level (row-level) a...
20 versions - Latest release: 4 months ago - 1 dependent package - 4 dependent repositories - 567 downloads last month - 76 stars on GitHub - 1 maintainer
naeval 0.2.0
Comparing quality and performance of NLP systems for Russian language
1 version - Latest release: about 4 years ago - 2 dependent repositories - 14 downloads last month - 44 stars on GitHub - 1 maintainer
rankereval 0.2.0
A fast implementation of ranking metrics for information retrieval and recommendation.
3 versions - Latest release: over 2 years ago - 1 dependent repositories - 51 downloads last month - 28 stars on GitHub - 1 maintainer
Top 1.2% on pypi.org
evaluate 0.4.2
HuggingFace community-driven open-source library of evaluation
15 versions - Latest release: about 1 month ago - 222 dependent packages - 2,474 dependent repositories - 2.89 million downloads last month - 1,762 stars on GitHub - 3 maintainers
dyff-client 0.6.0
Python client for the Dyff AI auditing platform.
15 versions - Latest release: 16 days ago - 2 dependent packages - 886 downloads last month - 0 stars on GitLab.com - 5 maintainers
dyff-schema 0.6.0
Data models for the Dyff AI auditing platform.
28 versions - Latest release: 16 days ago - 4 dependent packages - 1.43 thousand downloads last month - 0 stars on GitLab.com - 5 maintainers
orbis-eval 2.3.5
An Extendable Evaluation Pipeline for Named Entity Drill-Down Analysis
21 versions - Latest release: about 2 years ago - 1 dependent repositories - 65 downloads last month - 8 stars on GitHub - 3 maintainers
ntqr 0.3.2
Tools for the logic of evaluation using unlabeled data
5 versions - Latest release: about 1 month ago - 32 downloads last month - 34 stars on GitHub - 1 maintainer
waffle-hub 0.3.1
Waffle hub
31 versions - Latest release: 4 months ago - 260 downloads last month - 39 stars on GitHub - 1 maintainer
Top 9.7% on pypi.org
acconeer-exptool 7.10.0
Acconeer Exploration Tool
83 versions - Latest release: about 1 month ago - 1 dependent repositories - 1.52 thousand downloads last month - 164 stars on GitHub - 4 maintainers
alexandra-ai-eval 0.1.0
Evaluation of finetuned models.
1 version - Latest release: over 1 year ago - 1 dependent package - 33 downloads last month - 8 stars on GitHub - 2 maintainers
fdatasets 1.12.1 removed
HuggingFace/Datasets is an open library of NLP datasets.
1 version - Latest release: about 2 years ago - 14,671 stars on GitHub
llama-index-packs-rag-evaluator 0.1.3
llama-index packs rag_evaluator integration
5 versions - Latest release: 3 months ago - 78 downloads last month - 1 maintainer
nereval 0.2.5
Evaluation script for named entity recognition systems based on F1 score.
3 versions - Latest release: almost 6 years ago - 1 dependent repositories - 278 downloads last month - 67 stars on GitHub - 1 maintainer
pyspark-easy 1.5
Makes pyspark dataframe exploration easy
10 versions - Latest release: about 3 years ago - 1 dependent repositories - 28 downloads last month - 0 stars on GitHub - 1 maintainer
sed-scores-eval 0.0.3
(Threshold-Independent) Evaluation of Sound Event Detection Scores
4 versions - Latest release: about 1 month ago - 219 downloads last month - 22 stars on GitHub - 1 maintainer
promptbench 0.0.2
PromptBench is a powerful tool designed to scrutinize and analyze the interaction of large langua...
7 versions - Latest release: 6 months ago - 228 downloads last month - 2,071 stars on GitHub - 1 maintainer
dyff 0.19.0
Meta-package to install the local SDK for the Dyff AI auditing platform.
22 versions - Latest release: 15 days ago - 355 downloads last month - 5 maintainers
dyff-audit 0.3.3
Audit tools for the Dyff AI auditing platform.
16 versions - Latest release: 16 days ago - 1 dependent package - 713 downloads last month - 0 stars on GitLab.com - 5 maintainers
bob.bio.htface 1.0.6
Tools for running heterogeneous face recognition experiments
6 versions - Latest release: over 3 years ago - 22 downloads last month - 1 maintainer
factscorelite 1.3.0
FactScore (Fine-grained atomic evaluation of factual precision in long form text generation) comp...
10 versions - Latest release: about 1 month ago - 155 downloads last month - 0 stars on GitHub - 1 maintainer