hex.pm "benchmarking" keyword
eval_ex 0.1.5
Model evaluation harness for standardized benchmarking with semantic similarity, exact match, and...6 versions - Latest release: 3 months ago - 311 downloads total - 0 stars on GitHub - 1 maintainer
Top 1.3% on hex.pm
26 versions - Latest release: 5 months ago - 19 dependent packages - 1,078 dependent repositories - 9.59 million downloads total - 1,405 stars on GitHub - 2 maintainers
benchee 1.5.0
Versatile (micro) benchmarking that is extensible. Get statistics such as: average, iterations pe...26 versions - Latest release: 5 months ago - 19 dependent packages - 1,078 dependent repositories - 9.59 million downloads total - 1,405 stars on GitHub - 2 maintainers
crucible_datasets 0.5.4
Dataset management and caching for AI research benchmarks9 versions - Latest release: 3 months ago - 435 downloads total - 0 stars on GitHub - 1 maintainer
crucible_harness 0.3.3
Experimental research framework for running AI benchmarks at scale. Provides orchestration, strea...5 versions - Latest release: 3 months ago - 236 downloads total - 1 stars on GitHub - 1 maintainer
crucible_bench 0.4.0
Comprehensive benchmarking framework for AI research. Measures latency, throughput, cost, and rel...6 versions - Latest release: 3 months ago - 316 downloads total - 0 stars on GitHub - 1 maintainer
benchee_json 1.0.0
JSON formatter for the (micro) benchmarking library benchee.8 versions - Latest release: almost 7 years ago - 1 dependent package - 43 dependent repositories - 1.06 million downloads total - 6 stars on GitHub - 2 maintainers
benchee_csv 1.0.0
Get CSV from your benchee benchmarks to turn them into graphs or whatever!10 versions - Latest release: almost 7 years ago - 152 dependent repositories - 427 thousand downloads total - 10 stars on GitHub - 2 maintainers
Top 6.3% on hex.pm
9 versions - Latest release: about 2 years ago - 2 dependent packages - 126 dependent repositories - 911 thousand downloads total - 58 stars on GitHub - 2 maintainers
benchee_html 1.0.1
HTML formatter with pretty graphs for the (micro) benchmarking library benchee. Also allows expor...9 versions - Latest release: about 2 years ago - 2 dependent packages - 126 dependent repositories - 911 thousand downloads total - 58 stars on GitHub - 2 maintainers
Related Keywords
beam
4
research
4
elixir
4
otp
4
llm
4
machine-learning
4
ai
3
benchee
3
formatter
3
ensemble-methods
3
plugin
3
statistical-testing
3
reliability
3
hypothesis-testing
2
nshkr-crucible
2
statistical-analysis
2
statistics
2
experiment-orchestration
1
experiment-automation
1
automation
1
reporting
1
research-automation
1
test-harness
1
anova
1
effect-size
1
mann-whitney
1
power-analysis
1
t-test
1
testing-framework
1
json
1
csv
1
spreadsheet
1
graph
1
html
1
plotlyjs
1
ai-research
1
bleu
1
confidence-intervals
1
evaluation
1
f1-score
1
metrics
1
model-comparison
1
north-shore-ai
1
reproducibility
1
rouge
1
extensible
1
graphs
1
microbenchmarks
1
ai-benchmarks
1
benchmark-datasets
1
data-loading
1
dataset-management
1
datasets
1
gsm8k
1
humaneval
1
ml-datasets
1
mmlu
1