An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

npmjs.org "evaluation" keyword

clientcoded 0.5.0
ClientCoded SDK - Trace your AI agent's tool calls for root cause analysis
4 versions - Latest release: about 2 hours ago - 24 downloads last month - 0 stars on GitHub - 1 maintainer
@n8n/expression-runtime 0.35.0
Secure, isolated expression evaluation runtime for n8n
69 versions - Latest release: 11 days ago - 794 thousand downloads last month - 208,194 stars on GitHub - 5 maintainers
@stdlib/stats-incr-rmse 0.2.3 πŸ’°
Compute the root mean squared error (RMSE) incrementally.
13 versions - Latest release: 9 months ago - 3 dependent packages - 3 dependent repositories - 303 downloads last month - 1 stars on GitHub - 4 maintainers
@ssheleg/agent-stack 0.31.0
Production patterns for AI agent orchestrators β€” tool-calling loops, multi-stage pipelines with c...
59 versions - Latest release: about 6 hours ago - 1.88 thousand downloads last month - 4 stars on GitHub - 1 maintainer
@dailephd/my-dev-kit-lab 0.9.4 πŸ’°
Evidence, benchmark, and evaluation companion for my-dev-kit.
36 versions - Latest release: about 7 hours ago - 3.88 thousand downloads last month - 0 stars on GitHub - 1 maintainer
@orkestrel/study 0.0.3
Runs declared comparative studies with admitted requests, sealed execution custody, and independe...
4 versions - Latest release: about 9 hours ago - 0 stars on GitHub - 1 maintainer
@opensearch-project/agent-health 0.8.1
Agent Evaluation and Observability Framework
11 versions - Latest release: 1 day ago - 580 downloads last month - 35 stars on GitHub - 3 maintainers
langsmith-cai 0.0.63
Client library to connect to the LangSmith LLM Tracing and Evaluation Platform.
1 version - Latest release: over 2 years ago - 35 downloads last month - 1,082 stars on GitHub - 1 maintainer
h4r5h4-langsmith 0.0.63
Client library to connect to the LangSmith LLM Tracing and Evaluation Platform.
2 versions - Latest release: over 2 years ago - 34 downloads last month - 1,082 stars on GitHub - 1 maintainer
@covalai/mcp-server 0.1.0
Coval MCP Server - AI evaluation platform integration for Claude Desktop, Cursor, and other MCP c...
1 version - Latest release: 8 months ago - 8 downloads last month - 3 stars on GitHub - 1 maintainer
@coval/mcp-server 0.4.1
Coval MCP Server - AI evaluation platform integration for Claude Desktop, Cursor, and other MCP c...
4 versions - Latest release: 4 days ago - 56 downloads last month - 3 stars on GitHub - 5 maintainers
@coval/sdk 0.7.2
Typed TypeScript client for the Coval evaluation platform API.
16 versions - Latest release: 4 days ago - 1.66 thousand downloads last month - 2 stars on GitHub - 5 maintainers
coolhand-node 0.17.1
Monitor and LLM API calls for analysis
20 versions - Latest release: about 12 hours ago - 1.75 thousand downloads last month - 4 stars on GitHub - 1 maintainer
@trustmodel/local 0.1.0
Score any AI for trust β€” 100% local, no API key. Eval / Monitor / Govern across 10 trust dimensio...
1 version - Latest release: 2 months ago - 12 downloads last month - 0 stars on GitHub - 2 maintainers
agent-regression-testing 0.2.3
A standalone library for AI agent regression testing using LLM-as-judge evaluation
14 versions - Latest release: about 14 hours ago - 1.09 thousand downloads last month - 0 stars on GitHub - 1 maintainer
tracepad 0.1.0
Tracing, prompts, scores and evals for Node LLM apps, on OpenTelemetry β€” the client for Tracepad,...
3 versions - Latest release: 18 days ago - 385 downloads last month - 1 stars on GitHub - 1 maintainer
@drift_rail/sdk 2.4.1
DriftRail SDK - AI Safety & Observability Platform
9 versions - Latest release: about 14 hours ago - 26 downloads last month - 1 maintainer
@alexcarol/promptfoo 0.119.11 removed πŸ’°
LLM eval & testing toolkit
1 version - Latest release: 11 months ago - 9 downloads last month - 25,988 stars on GitHub - 1 maintainer
@arizeai/phoenix-client 7.16.2
A client for the Phoenix API
103 versions - Latest release: 2 days ago - 294 thousand downloads last month - 11,874 stars on GitHub - 5 maintainers
promptfoo 0.124.1 πŸ’°
LLM eval & testing toolkit
425 versions - Latest release: 16 days ago - 1 dependent repositories - 3.55 million downloads last month - 26,224 stars on GitHub - 5 maintainers
@arizeai/phoenix-evals 2.7.0
A library for running evaluations for AI use cases
39 versions - Latest release: 2 days ago - 152 thousand downloads last month - 11,874 stars on GitHub - 5 maintainers
@uipath/agent-sdk 1.204.0
SDK for the UiPath Agent Runtime API β€” evaluation execution and debug sessions.
185 versions - Latest release: 4 days ago - 9.79 thousand downloads last month - 26 maintainers
@pharmatools/opengate-mcp 0.1.4 πŸ’°
MCP server for OpenGATE β€” let an AI agent check whether its answers are grounded in the provided ...
5 versions - Latest release: 4 months ago - 153 downloads last month - 1 stars on GitHub - 1 maintainer
eva-install 0.5.0
Eva's command: installs the question bot into your web app, checks every link to a question on sc...
4 versions - Latest release: about 15 hours ago - 170 downloads last month - 1 maintainer
mlflow-anthropic 0.1.3
Anthropic integration package for MLflow Tracing
3 versions - Latest release: 9 months ago - 822 downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/codex 0.4.0
Codex CLI integration package for MLflow Tracing
4 versions - Latest release: about 2 months ago - 1.02 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
mlflow-tracing 0.1.3
TypeScript implementation of MLflow Tracing SDK for LLM observability
6 versions - Latest release: 9 months ago - 35.1 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
mlflow-vercel 0.1.1
Vercel AI SDK integration package for MLflow Tracing
1 version - Latest release: 12 months ago - 2.16 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/anthropic 0.4.0
Anthropic integration package for MLflow Tracing
3 versions - Latest release: about 2 months ago - 1.17 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/openai 0.4.0
OpenAI integration package for MLflow Tracing
3 versions - Latest release: about 2 months ago - 5.24 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
mlflow-openai 0.1.3
OpenAI integration package for MLflow Tracing
5 versions - Latest release: 9 months ago - 3.63 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/vercel 0.4.0
Vercel AI SDK integration for MLflow Tracing β€” SpanProcessor that translates AI SDK span attribut...
4 versions - Latest release: about 2 months ago - 12.2 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
@rollyjoely/mlflow-langchain 0.1.3
LangChain integration package for MLflow Tracing
1 version - Latest release: 8 months ago - 151 downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/core 0.4.0
TypeScript implementation of MLflow Tracing SDK for LLM observability
4 versions - Latest release: about 2 months ago - 74.6 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
mlflow-gemini 0.1.3
Gemini integration package for MLflow Tracing
3 versions - Latest release: 9 months ago - 15 downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/mlflow-openclaw 0.2.0-rc.0
OpenClaw integration package for MLflow Tracing
1 version - Latest release: 6 months ago - 40 downloads last month - 28,439 stars on GitHub - 1 maintainer
@typia/jev 15.1.0 πŸ’°
Jev evaluation model integration for typia
5 versions - Latest release: 21 days ago - 785 downloads last month - 5,948 stars on GitHub - 1 maintainer
@rollyjoely/mlflow-tracing 0.1.3
TypeScript implementation of MLflow Tracing SDK for LLM observability
2 versions - Latest release: 8 months ago - 14 downloads last month - 28,439 stars on GitHub - 1 maintainer
@rollyjoely/mlflow-anthropic 0.1.3
Anthropic integration package for MLflow Tracing
2 versions - Latest release: 8 months ago - 10 downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/qwen-code 0.4.0
Qwen Code integration package for MLflow Tracing
3 versions - Latest release: about 2 months ago - 114 downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/claude-code 0.4.0
Claude Code and Claude Agent SDK integration package for MLflow Tracing
6 versions - Latest release: about 2 months ago - 22.8 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/opencode 0.4.0
OpenCode integration package for MLflow Tracing
3 versions - Latest release: about 2 months ago - 206 downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/gemini 0.4.0
Gemini integration package for MLflow Tracing
3 versions - Latest release: about 2 months ago - 169 downloads last month - 28,439 stars on GitHub - 1 maintainer
llm-judge 1.0.0
CLI tool for evaluating artifacts with LLMs β€” Swiss Elo ranking, pass/gate, and qualitative review
1 version - Latest release: 6 months ago - 19 downloads last month - 0 stars on GitHub - 1 maintainer
Top 9.8% on npmjs.org
fig-tree-evaluator 2.23.2
Module to evaluate JSON-structured expression trees
109 versions - Latest release: about 1 month ago - 3 dependent packages - 1 dependent repositories - 4.66 thousand downloads last month - 25 stars on GitHub - 1 maintainer
@dynatrace-oss/dt-eval-lib 0.0.21-alpha
Minimal TypeScript library for running LLM-as-a-judge evaluations
13 versions - Latest release: about 18 hours ago - 7.53 thousand downloads last month - 51 stars on GitHub - 2 maintainers
@trustmodel/sdk 0.4.0
Official TypeScript/Node SDK for TrustModel β€” AI trust evaluation, OTel telemetry, and agent gove...
9 versions - Latest release: about 18 hours ago - 101 downloads last month - 2 stars on GitHub - 1 maintainer
57b-agenteval 0.3.0
Model and workflow evaluation harness conforming to the Agent Evaluation Protocol v0.4
3 versions - Latest release: about 18 hours ago - 1 maintainer
skillgrade 0.5.0
The easiest way to evaluate your Agent Skills and AI agents β€” test that AI agents correctly disco...
15 versions - Latest release: 12 days ago - 738 downloads last month - 729 stars on GitHub - 1 maintainer
@kmonty/skillgrade 0.1.17
The easiest way to evaluate your Agent Skills β€” test that AI agents correctly discover and use yo...
18 versions - Latest release: 6 months ago - 21 downloads last month - 729 stars on GitHub - 2 maintainers
@mcpjam/inspector 3.16.2 πŸ’°
MCPJam Inspector
306 versions - Latest release: 4 days ago - 38.8 thousand downloads last month - 2,266 stars on GitHub - 2 maintainers
@fre4x/benchmark 1.1.29
A deterministic benchmark MCP server for agent evaluation workflows.
18 versions - Latest release: about 22 hours ago - 231 downloads last month - 1 maintainer
@thomasfosterau/effect-evals 0.5.1
An Effect-native LLM evaluation toolkit β€” goldens, scorers, thresholds, metrics (G-Eval, RAG, ret...
10 versions - Latest release: about 23 hours ago - 1.34 thousand downloads last month - 1 stars on GitHub - 1 maintainer
@gnldev/evals 0.14.0
Scorers + LLM-judge for @gnldev/durable. scoreRun reads the journal trace β†’ deterministic, replay...
16 versions - Latest release: about 23 hours ago - 2.17 thousand downloads last month - 2 stars on GitHub - 1 maintainer
@gnldev/semantic-qualify 0.14.0
Qualification bench for GNL's semantic judge: measures a judge closure against blind fixtures and...
16 versions - Latest release: about 22 hours ago - 2.05 thousand downloads last month - 2 stars on GitHub - 1 maintainer
Top 2.2% on npmjs.org
define-lazy-prop 3.0.0 πŸ’°
Define a lazily evaluated property on an object
3 versions - Latest release: over 5 years ago - 505 dependent packages - 1,174,541 dependent repositories - 434 million downloads last month - 67 stars on GitHub - 1 maintainer
dsh-session-eval 0.3.0
Retrospective agent-session evaluation for DeepSeek Harness: deterministic grade cards from persi...
7 versions - Latest release: 1 day ago - 1.11 thousand downloads last month - 0 stars on GitHub - 1 maintainer
@razorwind/benchmark 0.0.34 πŸ’°
Razorwind plugin for evaluating design-system effectiveness with AI coding agents.
31 versions - Latest release: 2 days ago - 3.4 thousand downloads last month - 0 stars on GitHub - 1 maintainer
@holonograph/types-public 0.17.0
Public wire-format types and zod schemas for a Holonograph lens β€” the shared contract between the...
13 versions - Latest release: 1 day ago - 627 downloads last month - 1 maintainer
@holonograph/client 0.17.0
TypeScript HTTP client for a Holonograph lens. Send messages through the lens and report scored o...
20 versions - Latest release: 1 day ago - 661 downloads last month - 0 stars on GitHub - 1 maintainer
@remnic/bench 9.69.56 πŸ’°
Retrieval latency ladder benchmarks + CI regression gates for @remnic/core
602 versions - Latest release: about 2 months ago - 5.47 thousand downloads last month - 228 stars on GitHub - 1 maintainer
@plune-ai/cli 0.30.0
AI-powered assertion testing for LLM apps β€” write assertions, run them against any provider, get ...
37 versions - Latest release: 1 day ago - 8.7 thousand downloads last month - 0 stars on GitHub - 1 maintainer
@ixo/decision-oracle 0.2.22
Run an IXO evaluation oracle: pull claims, produce facts with your handlers, let the decision eng...
24 versions - Latest release: 2 days ago - 2 maintainers
@frontierharness/eval 0.0.2
Benchmark your own coding-agent harness against FrontierHarness Eval: sets up the benchmark works...
2 versions - Latest release: about 2 months ago - 99 downloads last month - 316 stars on GitHub - 2 maintainers
pi-autocontext 0.10.0
autocontext extension for Pi coding agent β€” iterative strategy generation, LLM judging, and evalu...
11 versions - Latest release: 2 months ago - 142 downloads last month - 1,310 stars on GitHub - 1 maintainer
autoctx 0.19.0
autocontext β€” always-on agent evaluation harness
46 versions - Latest release: 26 days ago - 1.29 thousand downloads last month - 1,310 stars on GitHub - 1 maintainer
modelcheck-cli 0.2.0
Local regression testing for AI applications: baseline, verify and compare model or configuration...
4 versions - Latest release: 1 day ago - 0 stars on GitHub - 1 maintainer
opik-openai 2.2.117
Opik TypeScript and JavaScript SDK integration with OpenAI
365 versions - Latest release: 1 day ago - 10.7 thousand downloads last month - 22,776 stars on GitHub - 1 maintainer
opik 2.2.117
Opik TypeScript and JavaScript SDK
583 versions - Latest release: 1 day ago - 147 thousand downloads last month - 22,776 stars on GitHub - 1 maintainer
opik-otel 2.2.117
Opik TypeScript and JavaScript SDK integration with OpenTelemetry
209 versions - Latest release: 1 day ago - 5.98 thousand downloads last month - 22,776 stars on GitHub - 1 maintainer
opik-gemini 2.2.116
Opik TypeScript and JavaScript SDK integration with Google Gemini AI
363 versions - Latest release: 1 day ago - 14.3 thousand downloads last month - 22,776 stars on GitHub - 1 maintainer
opik-langchain 2.2.116
Opik TypeScript and JavaScript SDK integration with LangChain
368 versions - Latest release: 1 day ago - 13.2 thousand downloads last month - 22,776 stars on GitHub - 1 maintainer
opik-vercel 2.2.116
Opik TypeScript and JavaScript SDK integration with Vercel AI SDK
363 versions - Latest release: 1 day ago - 13.5 thousand downloads last month - 22,776 stars on GitHub - 1 maintainer
wyrd-ai 0.3.0
TypeScript SDK for Wyrd: verification and assurance for AI systems.
5 versions - Latest release: 1 day ago - 2 stars on GitHub - 1 maintainer
dsh-eval-guard 0.7.2
Evaluation guard for DSH: workspace-only filesystem, no network/subagents, wall-clock limits, and...
24 versions - Latest release: 3 days ago - 1.62 thousand downloads last month - 0 stars on GitHub - 1 maintainer
@sbissoli/mcp-evals 0.2.2
Harness de evals para servidores MCP: seleΓ§Γ£o de tool em turno ΓΊnico (catΓ‘logo, fixtures, scorer,...
5 versions - Latest release: 16 days ago - 2.17 thousand downloads last month - 1 stars on GitHub - 1 maintainer
mongodb-assistant-eval 0.1.1
Evaluation library for the MongoDB Assistant API.
8 versions - Latest release: 1 day ago - 39.3 thousand downloads last month - 2 maintainers
@goyamegh/agent-health 0.5.23
Agent Evaluation and Observability Framework
83 versions - Latest release: 4 months ago - 278 downloads last month - 35 stars on GitHub - 1 maintainer
@magland/gentl 0.1.0
A readability test for codebases: a memoryless agent carries out a newcomer task and gentl measur...
2 versions - Latest release: 1 day ago - 1 maintainer
@dataprime1/dreamd 0.0.0 deprecated
Portable memory layer for AI coding agents β€” pre-release
1 version - Latest release: 6 months ago - 12 downloads last month - 5 stars on GitHub - 1 maintainer
dreamd-mcp 1.0.1
Local-first memory for AI coding agents. One .agent/ folder shared by Claude Code, Cursor and Cli...
11 versions - Latest release: 1 day ago - 367 downloads last month - 5 stars on GitHub - 1 maintainer
@fulllifegames/eval-engine 0.7.1
Position evaluation for PokΓ©mon Showdown replays: reconstruction, search, per-turn analysis, and ...
2 versions - Latest release: about 2 months ago - 293 downloads last month - 0 stars on GitHub - 1 maintainer
@swissspidy/belay-calibrate 0.1.1 πŸ’°
Calibrate Belay task thresholds on labeled data in a real Chrome: CLI, calibration file and HTML ...
3 versions - Latest release: 15 days ago - 0 stars on GitHub - 1 maintainer
viteval 0.5.9 πŸ’°
Next generation LLM evaluation framework powered by Vitest.
32 versions - Latest release: 7 months ago - 7.49 thousand downloads last month - 51 stars on GitHub - 1 maintainer
@smthrs/evals 1.0.0-rc.3
Fixed-suite evaluation, baselines, regression reports, and score gates for flows
13 versions - Latest release: 14 days ago - 457 downloads last month - 439 stars on GitHub - 1 maintainer
@auraone/github-app 1.0.0
GitHub App for automated AuraOne evaluations on pull requests
3 versions - Latest release: 5 days ago - 62 downloads last month - 0 stars on GitHub - 1 maintainer
@auraone/sdk 1.0.0
Official TypeScript SDK for AuraOne API - Comprehensive AI platform for training, analytics, and ...
8 versions - Latest release: 5 days ago - 113 downloads last month - 0 stars on GitHub - 1 maintainer
@spechtlabs/sigil 0.8.3
The Sigil policy language in JavaScript: the Go engine compiled to WebAssembly, with typed bindings
11 versions - Latest release: 9 days ago - 1.59 thousand downloads last month - 1 stars on GitHub - 1 maintainer
@pauly4010/evalai-sdk 1.9.1
AI Evaluation Platform SDK - Complete API Coverage with Performance Optimizations
13 versions - Latest release: 8 months ago - 103 downloads last month - 0 stars on GitHub - 1 maintainer
@ragbits/api-client 1.6.2
JavaScript client for the Ragbits API
23 versions - Latest release: 7 months ago - 39 downloads last month - 1,678 stars on GitHub - 2 maintainers
@ragbits/api-client-react 1.6.2
React hooks for the Ragbits API client
21 versions - Latest release: 7 months ago - 37 downloads last month - 1,678 stars on GitHub - 2 maintainers
@learning-commons/evaluators 1.2.0
TypeScript SDK for Learning Commons educational evaluators
12 versions - Latest release: 9 days ago - 1.06 thousand downloads last month - 86 stars on GitHub - 1 maintainer
mossbear 0.1.0-alpha.96
Durable, evolving artifacts that you and your coding agents write together β€” your rules, skills a...
71 versions - Latest release: 2 days ago - 8.39 thousand downloads last month - 1 maintainer
@hikae/jev-algorithms 0.3.0
Runtime-agnostic algorithms built on TypeSafe's Jev structured-evaluation model.
4 versions - Latest release: about 1 month ago - 397 downloads last month - 0 stars on GitHub - 1 maintainer
@woocommerce/expression-evaluation 2.0.0
Library for evaluating expressions.
2 versions - Latest release: 4 months ago - 1 dependent package - 45 downloads last month - 10,558 stars on GitHub - 9 maintainers
judgeval 1.3.5
JavaScript/TypeScript client for Judgment evaluation platform
57 versions - Latest release: 15 days ago - 155 thousand downloads last month - 5 stars on GitHub - 2 maintainers
quantum-reasoning-skill 1.1.5
Quantum-inspired reasoning skill for exploring multiple solution paths
7 versions - Latest release: 10 days ago - 719 downloads last month - 3 stars on GitHub - 1 maintainer
@galaxy-foundry/gxwf-pi-harness 0.4.2
Pi-backed isolated worker runner and extension for testing Galaxy Workflow Foundry skills.
6 versions - Latest release: 7 days ago - 335 downloads last month - 3 stars on GitHub - 1 maintainer
@atlasauth/pca-control-evals 0.4.1
Empirical adversarial control-evaluation harness for PCA: a seeded red-team/blue-team game (Redwo...
6 versions - Latest release: 12 days ago - 0 stars on GitHub - 1 maintainer
@langwatch/server 3.21.0
Run LangWatch locally with one command β€” `npx @langwatch/server`. Complete LangWatch stack: obser...
55 versions - Latest release: 2 days ago - 2.22 thousand downloads last month - 4,981 stars on GitHub - 3 maintainers