An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

npmjs.org "evaluation" keyword

coolhand-node 0.18.0
Monitor and LLM API calls for analysis
21 versions - Latest release: about 5 hours ago - 1.7 thousand downloads last month - 4 stars on GitHub - 1 maintainer
h4r5h4-langsmith 0.0.63
Client library to connect to the LangSmith LLM Tracing and Evaluation Platform.
2 versions - Latest release: almost 3 years ago - 22 downloads last month - 1,082 stars on GitHub - 1 maintainer
@mlflow/qwen-code 0.4.0
Qwen Code integration package for MLflow Tracing
3 versions - Latest release: 2 months ago - 100 downloads last month - 28,533 stars on GitHub - 1 maintainer
opik-ts 0.1.3
The Opik configure tool helps you to configure your Node.js project with Opik SDK
1 version - Latest release: about 1 year ago - 21 downloads last month - 23,149 stars on GitHub - 1 maintainer
dsh-rubric 0.0.1
Scoring rubrics for agent work - name reserved; first release in development.
1 version - Latest release: about 2 months ago - 0 downloads last month - 2 stars on GitHub - 1 maintainer
@mlflow/gemini 0.4.0
Gemini integration package for MLflow Tracing
3 versions - Latest release: 2 months ago - 325 downloads last month - 28,630 stars on GitHub - 1 maintainer
openmerit 0.3.3
Evidence-driven model decisions for coding harnesses.
29 versions - Latest release: about 6 hours ago - 3.15 thousand downloads last month - 2 maintainers
@tangle-network/playproof 0.10.0
Turn games into verifiable, cost-aware benchmarks for any agent.
10 versions - Latest release: 2 months ago - 98 downloads last month - 0 stars on GitHub - 1 maintainer
@artemiskit/core 0.6.4
Core runner, evaluators, and storage for ArtemisKit LLM evaluation toolkit
22 versions - Latest release: about 1 month ago - 2.85 thousand downloads last month - 7 stars on GitHub - 1 maintainer
@devilsdev/rag-pipeline-utils 3.6.0
Composable retrieval-augmented generation (RAG) for Node.js: grounded citations, evaluation, guar...
41 versions - Latest release: about 11 hours ago - 2.93 thousand downloads last month - 1 stars on GitHub - 1 maintainer
@mlflow/mlflow-openclaw 0.2.0-rc.0
OpenClaw integration package for MLflow Tracing
1 version - Latest release: 6 months ago - 37 downloads last month - 28,630 stars on GitHub - 1 maintainer
opik-vercel 2.2.142
Opik TypeScript and JavaScript SDK integration with Vercel AI SDK
389 versions - Latest release: about 8 hours ago - 13 thousand downloads last month - 23,149 stars on GitHub - 1 maintainer
@mlflow/anthropic 0.4.0
Anthropic integration package for MLflow Tracing
3 versions - Latest release: 2 months ago - 3.49 thousand downloads last month - 28,533 stars on GitHub - 1 maintainer
mlflow-openai 0.1.3
OpenAI integration package for MLflow Tracing
5 versions - Latest release: 9 months ago - 3.55 thousand downloads last month - 28,533 stars on GitHub - 1 maintainer
@spechtlabs/sigil 0.8.3
The Sigil policy language in JavaScript: the Go engine compiled to WebAssembly, with typed bindings
11 versions - Latest release: 22 days ago - 1.59 thousand downloads last month - 1 stars on GitHub - 1 maintainer
@mlflow/core 0.4.0
TypeScript implementation of MLflow Tracing SDK for LLM observability
4 versions - Latest release: 2 months ago - 74 thousand downloads last month - 28,533 stars on GitHub - 1 maintainer
@rollyjoely/mlflow-anthropic 0.1.3
Anthropic integration package for MLflow Tracing
2 versions - Latest release: 9 months ago - 20 downloads last month - 28,533 stars on GitHub - 1 maintainer
mlflow-vercel 0.1.1
Vercel AI SDK integration package for MLflow Tracing
1 version - Latest release: 12 months ago - 12.2 thousand downloads last month - 28,533 stars on GitHub - 1 maintainer
@rollyjoely/mlflow-tracing 0.1.3
TypeScript implementation of MLflow Tracing SDK for LLM observability
2 versions - Latest release: 9 months ago - 16 downloads last month - 28,630 stars on GitHub - 1 maintainer
@mlflow/vercel 0.4.0
Vercel AI SDK integration for MLflow Tracing — SpanProcessor that translates AI SDK span attribut...
4 versions - Latest release: 2 months ago - 11.5 thousand downloads last month - 28,630 stars on GitHub - 1 maintainer
@serghei/tevu 0.1.0 💰
Task Evaluation & Verification Utility for AI coding agents
3 versions - Latest release: 29 days ago - 424 downloads last month - 1 stars on GitHub - 1 maintainer
eva-install 0.7.0
Eva's command: installs the question bot into your web app, checks every link to a question on sc...
8 versions - Latest release: about 7 hours ago - 170 downloads last month - 1 maintainer
hue-run 0.27.0
Alias of @hue-run/sdk. Install @hue-run/sdk directly; this package only re-exports it.
19 versions - Latest release: 1 day ago - 747 downloads last month - 0 stars on GitHub - 1 maintainer
@hue-run/sdk 0.26.0
Hue OpenTelemetry helpers for Node.js agent applications
62 versions - Latest release: 11 days ago - 89.5 thousand downloads last month - 0 stars on GitHub - 1 maintainer
@zenera/gym 1.1.56
Simulated API environments for agent training and evaluation, powered by OpenAPI and model-writte...
20 versions - Latest release: about 10 hours ago - 3.22 thousand downloads last month - 8 stars on GitHub - 1 maintainer
@arizeai/phoenix-client 7.18.1
A client for the Phoenix API
107 versions - Latest release: 1 day ago - 200 thousand downloads last month - 12,081 stars on GitHub - 5 maintainers
@coval/sdk 0.9.28
Typed TypeScript client for the Coval evaluation platform API.
41 versions - Latest release: about 11 hours ago - 4.32 thousand downloads last month - 0 stars on GitHub - 5 maintainers
@drift_rail/sdk 2.7.0
DriftRail SDK - AI Safety & Observability Platform
14 versions - Latest release: about 22 hours ago - 26 downloads last month - 1 maintainer
promptfoo 0.125.1 💰
LLM eval & testing toolkit
427 versions - Latest release: 12 days ago - 1 dependent repositories - 3.59 million downloads last month - 26,850 stars on GitHub - 5 maintainers
@remnic/bench 9.69.56 💰
Retrieval latency ladder benchmarks + CI regression gates for @remnic/core
659 versions - Latest release: 2 months ago - 8.19 thousand downloads last month - 230 stars on GitHub - 1 maintainer
@alexcarol/promptfoo 0.119.11 removed 💰
LLM eval & testing toolkit
1 version - Latest release: 12 months ago - 9 downloads last month - 26,850 stars on GitHub - 1 maintainer
@devilsdev/rag-eval 3.6.0
RAG evaluation: faithfulness, relevance, context precision and recall, groundedness, datasets, re...
6 versions - Latest release: about 11 hours ago - 436 downloads last month - 1 stars on GitHub - 1 maintainer
nanohype 0.1.3
The nanohype CLI — scaffold templates and composites from the nanohype catalog. Thin entry point ...
2 versions - Latest release: about 1 month ago - 33 downloads last month - 2 stars on GitHub - 1 maintainer
@nanohype/sdk 0.3.0
Reference implementation of the nanohype template rendering contract, catalog discovery, and Plat...
3 versions - Latest release: about 1 month ago - 105 downloads last month - 2 stars on GitHub - 1 maintainer
@nanohype/mcp 0.2.0
MCP server exposing the nanohype Platform Reference (catalog + standards + per-repo contracts) as...
2 versions - Latest release: about 1 month ago - 49 downloads last month - 2 stars on GitHub - 1 maintainer
skillfid 0.2.7
Evaluate how faithfully agent skills apply their source documentation
11 versions - Latest release: 1 day ago - 860 downloads last month - 1 stars on GitHub - 1 maintainer
opik 2.2.141
Opik TypeScript and JavaScript SDK
607 versions - Latest release: about 11 hours ago - 143 thousand downloads last month - 23,149 stars on GitHub - 1 maintainer
@artemiskit/adapter-trueforge 0.1.12
TrueForge agent-harness adapter for ArtemisKit
12 versions - Latest release: about 1 month ago - 71 downloads last month - 7 stars on GitHub - 1 maintainer
opik-gemini 2.2.141
Opik TypeScript and JavaScript SDK integration with Google Gemini AI
388 versions - Latest release: about 11 hours ago - 19 thousand downloads last month - 23,149 stars on GitHub - 1 maintainer
@plune-ai/cli 0.33.0
AI-powered assertion testing for LLM apps — write assertions, run them against any provider, get ...
44 versions - Latest release: about 11 hours ago - 13.5 thousand downloads last month - 0 stars on GitHub - 1 maintainer
mlflow-anthropic 0.1.3
Anthropic integration package for MLflow Tracing
3 versions - Latest release: 9 months ago - 708 downloads last month - 28,533 stars on GitHub - 1 maintainer
@physionlabs/galileo 0.1.0-rc.3
Official Node.js and TypeScript client for the Galileo video evaluation API.
8 versions - Latest release: 2 months ago - 908 downloads last month - 0 stars on GitHub - 1 maintainer
hupothesis 0.0.1
Time weighted evaluation engine middleware
1 version - Latest release: over 10 years ago - 2 dependent packages - 1 dependent repositories - 12 downloads last month - 0 stars on GitHub - 1 maintainer
@mcpjam/inspector 3.18.0 💰
MCPJam Inspector
308 versions - Latest release: 8 days ago - 56.6 thousand downloads last month - 2,297 stars on GitHub - 2 maintainers
web-codegen-scorer 0.0.70 deprecated
Web Codegen Scorer is a tool for evaluating the quality of web code generated by Large Language M...
71 versions - Latest release: 7 months ago - 7.49 thousand downloads last month - 771 stars on GitHub - 1 maintainer
finch-jev 0.1.1
Structured evaluation with Jev (TypeSafe AI System One) — via TypeSafe's own API or OpenRouter.
2 versions - Latest release: about 2 months ago - 74 stars on GitHub - 1 maintainer
@tpmjs/tools-judge 0.1.0
AI conversation quality judge. Evaluates AI SDK messages across 10 metrics with scores, reasoning...
1 version - Latest release: 10 months ago - 13 downloads last month - 24 stars on GitHub - 1 maintainer
com.anupackages.debugconsole.expressions 1.0.1
Enable Expression evaluation for com.anupackages.debugconsole command line
2 versions - Latest release: 2 months ago - 37 downloads last month - 0 stars on GitHub - 1 maintainer
@fluce/proctor 0.2.1
Agent-agnostic evaluation harness for coding agents and their plugins, skills and tools: test-fra...
3 versions - Latest release: 1 day ago - 1 maintainer
mlflow-tracing 0.1.3
TypeScript implementation of MLflow Tracing SDK for LLM observability
6 versions - Latest release: 9 months ago - 41.2 thousand downloads last month - 28,533 stars on GitHub - 1 maintainer
@qualweb/best-practices 0.7.13
QualWeb best practices
114 versions - Latest release: 4 months ago - 3 dependent packages - 3 dependent repositories - 1.98 thousand downloads last month - 25 stars on GitHub - 4 maintainers
dsh-session-eval 0.4.1
Retrospective agent-session evaluation for DeepSeek Harness: deterministic grade cards from persi...
9 versions - Latest release: about 15 hours ago - 1.02 thousand downloads last month - 0 stars on GitHub - 1 maintainer
dsh-judge 0.0.1
LLM-as-judge evaluation - name reserved; first release in development.
1 version - Latest release: about 2 months ago - 15 downloads last month - 2 stars on GitHub - 1 maintainer
Top 9.6% on npmjs.org
@qualweb/wcag-techniques 0.4.9
Implementation of the WCAG 2.1 techniques
78 versions - Latest release: about 2 months ago - 2 dependent packages - 3 dependent repositories - 1.9 thousand downloads last month - 25 stars on GitHub - 4 maintainers
@deranged/qualweb-best-practices 0.9.0
QualWeb best practices
4 versions - Latest release: 6 months ago - 31 downloads last month - 25 stars on GitHub - 5 maintainers
@deranged/qualweb-wcag-techniques 0.6.0
Implementation of the WCAG 2.1 techniques
5 versions - Latest release: 6 months ago - 96 downloads last month - 25 stars on GitHub - 5 maintainers
@orkestrel/study 0.0.10
Runs declared comparative studies with admitted requests, sealed execution custody, and independe...
11 versions - Latest release: 2 days ago - 942 downloads last month - 0 stars on GitHub - 1 maintainer
@n8n/expression-runtime 0.37.5
Secure, isolated expression evaluation runtime for n8n
83 versions - Latest release: 1 day ago - 780 thousand downloads last month - 209,559 stars on GitHub - 5 maintainers
@sublime.am/skill 2.1.1
Guide business needs to production-ready procedural agents on Sublime. Discover and validate the ...
6 versions - Latest release: 1 day ago - 189 downloads last month - 1 stars on GitHub - 1 maintainer
truthy.js 0.6.1
Functions to simplify/normalize rules with the ability to leverage monads and applicative functor...
4 versions - Latest release: almost 13 years ago - 4 dependent packages - 5 dependent repositories - 15 downloads last month - 1 maintainer
@razorwind/benchmark 0.0.37 💰
Razorwind plugin for evaluating design-system effectiveness with AI coding agents.
34 versions - Latest release: 13 days ago - 3.29 thousand downloads last month - 0 stars on GitHub - 1 maintainer
@i18n-doctor/constants 0.10.2
Static constant evaluation for translation key resolution
5 versions - Latest release: 2 months ago - 1.18 thousand downloads last month - 2 stars on GitHub - 1 maintainer
@artemiskit/cli 0.6.2
Command-line interface for ArtemisKit LLM evaluation toolkit
25 versions - Latest release: about 1 month ago - 1.21 thousand downloads last month - 7 stars on GitHub - 1 maintainer
@artemiskit/reports 0.5.0
HTML report generation for ArtemisKit LLM evaluation toolkit
22 versions - Latest release: about 1 month ago - 1.2 thousand downloads last month - 7 stars on GitHub - 1 maintainer
@artemiskit/sdk 0.6.3
Programmatic SDK for ArtemisKit LLM evaluation toolkit - integrate into your Node.js apps
15 versions - Latest release: about 1 month ago - 1.65 thousand downloads last month - 7 stars on GitHub - 1 maintainer
@agentick/eval 0.15.4
Testing-shaped eval framework for Agentick. defineEval(...) returns a callable with runtime param...
3 versions - Latest release: 3 months ago - 77 downloads last month - 7 stars on GitHub - 2 maintainers
@ops-ai/toggly-eval 2.1.1
Local feature-definition evaluation engine for Toggly server SDKs
8 versions - Latest release: 18 days ago - 9.84 thousand downloads last month - 5 stars on GitHub - 2 maintainers
@mlflow/openai 0.4.0
OpenAI integration package for MLflow Tracing
3 versions - Latest release: 2 months ago - 5.73 thousand downloads last month - 28,630 stars on GitHub - 1 maintainer
@seclai/cli 1.8.1
Seclai Command Line Interface — manage agents, knowledge bases, sources, memory banks, and more f...
23 versions - Latest release: about 17 hours ago - 441 downloads last month - 2 stars on GitHub - 1 maintainer
opik-configure 0.1.2
The Opik configure tool helps you to configure your Node.js project with Opik SDK
2 versions - Latest release: about 1 year ago - 54 downloads last month - 23,149 stars on GitHub - 1 maintainer
@coder/aegis-darwin-arm64 0.24.0
The darwin-arm64 aegis CLI binary for @coder/aegis
38 versions - Latest release: about 17 hours ago - 0 downloads last month - 1 maintainer
langsmith-cai 0.0.63
Client library to connect to the LangSmith LLM Tracing and Evaluation Platform.
1 version - Latest release: almost 3 years ago - 35 downloads last month - 1,082 stars on GitHub - 1 maintainer
@future-agi/sdk 0.2.0
We help GenAI teams maintain high-accuracy for their Models in production.
4 versions - Latest release: about 18 hours ago - 49 downloads last month - 52 stars on GitHub - 3 maintainers
@ruvector/ruvllm 4.0.1
Bounded RuVLLM weight experiments, a durable GPU job loop with a Vast.ai host adapter, and verifi...
21 versions - Latest release: about 23 hours ago - 444 thousand downloads last month - 4,604 stars on GitHub - 1 maintainer
@uipath/agent-sdk 1.205.0
SDK for the UiPath Agent Runtime API — evaluation execution and debug sessions.
206 versions - Latest release: 2 days ago - 8.65 thousand downloads last month - 26 maintainers
opik-langchain 2.2.140
Opik TypeScript and JavaScript SDK integration with LangChain
392 versions - Latest release: 1 day ago - 14 thousand downloads last month - 23,149 stars on GitHub - 1 maintainer
opik-openai 2.2.140
Opik TypeScript and JavaScript SDK integration with OpenAI
388 versions - Latest release: 1 day ago - 12.1 thousand downloads last month - 23,149 stars on GitHub - 1 maintainer
@aegisai/opik 1.7.27-fork.1
Opik TypeScript and JavaScript SDK
2 versions - Latest release: over 1 year ago - 15 downloads last month - 23,149 stars on GitHub - 1 maintainer
@ankhorage/rules 0.4.0 💰
Domain-agnostic rule engine and JSON configuration for Ankhorage.
5 versions - Latest release: 1 day ago - 72.5 thousand downloads last month - 0 stars on GitHub - 1 maintainer
langwatch 2.2.0
LangWatch TypeScript/JavaScript SDK. Interact with the full LangWatch API and use the LangWatch O...
83 versions - Latest release: 2 days ago - 133 thousand downloads last month - 5,011 stars on GitHub - 3 maintainers
@mupt-ai/dari-pareto 0.7.1
Static and interactive Pareto frontier plots for evaluation results.
11 versions - Latest release: 1 day ago - 2.16 thousand downloads last month - 0 stars on GitHub - 2 maintainers
@noetic-tools/eval 1.3.0
Eval framework for Noetic agents: the describe/it/scorer suite runner, built-in and custom scorer...
8 versions - Latest release: 2 days ago - 0 downloads last month - 18 stars on GitHub - 1 maintainer
@learning-commons/evaluators 1.3.0
TypeScript SDK for Learning Commons educational evaluators
13 versions - Latest release: about 24 hours ago - 997 downloads last month - 86 stars on GitHub - 1 maintainer
@jtsang/jev-cli 0.3.0 💰
Command-line interface for TypeSafe AI's Jev evaluation model — evaluate typed questions against ...
5 versions - Latest release: about 2 months ago - 985 downloads last month - 3 stars on GitHub - 1 maintainer
@mlflow/claude-code 0.4.0
Claude Code and Claude Agent SDK integration package for MLflow Tracing
6 versions - Latest release: 2 months ago - 19.9 thousand downloads last month - 28,533 stars on GitHub - 1 maintainer
@coder/aegis 0.23.2
A/B testing for coding agents. Compare skills, prompts, models, and harnesses on task success, co...
37 versions - Latest release: 2 days ago - 1.85 thousand downloads last month - 1 maintainer
opik-otel 2.2.140
Opik TypeScript and JavaScript SDK integration with OpenTelemetry
232 versions - Latest release: 1 day ago - 7.03 thousand downloads last month - 23,149 stars on GitHub - 1 maintainer
@arizeai/phoenix-evals 2.7.1
A library for running evaluations for AI use cases
40 versions - Latest release: 9 days ago - 54 thousand downloads last month - 12,081 stars on GitHub - 5 maintainers
mossbear 0.1.0-alpha.108
Durable, evolving artifacts that you and your coding agents write together — your rules, skills a...
83 versions - Latest release: 1 day ago - 7.36 thousand downloads last month - 1 maintainer
@ixo/decision-oracle 0.2.29
Run an IXO evaluation oracle: pull claims, produce facts with your handlers, let the decision eng...
31 versions - Latest release: 1 day ago - 2 maintainers
@avsbhq/core 1.7.0
Shared evaluation engine and types for the A vs B SDKs: flag evaluation, audiences, bucketing, an...
7 versions - Latest release: 18 days ago - 716 downloads last month - 0 stars on GitHub - 1 maintainer
@cogitator-ai/evals 0.14.0
Evaluation framework for Cogitator AI agents
24 versions - Latest release: 9 days ago - 69 downloads last month - 43 stars on GitHub - 1 maintainer
@orq-ai/evaluatorq 1.3.2
Evaluation framework with Effect-based architecture for running parallel AI evaluations
29 versions - Latest release: 6 months ago - 910 downloads last month - 10 stars on GitHub - 2 maintainers
@mlflow/codex 0.4.0
Codex CLI integration package for MLflow Tracing
4 versions - Latest release: 2 months ago - 2.05 thousand downloads last month - 28,630 stars on GitHub - 1 maintainer
@rollyjoely/mlflow-langchain 0.1.3
LangChain integration package for MLflow Tracing
1 version - Latest release: 9 months ago - 165 downloads last month - 28,630 stars on GitHub - 1 maintainer
dreamd-mcp 1.2.2
Agent memory you can audit. Every lesson cites its source; trace a bad memory and remove it with ...
14 versions - Latest release: 1 day ago - 863 downloads last month - 6 stars on GitHub - 1 maintainer
dsh-anic 0.56.0
ANIC — AI-Native Iteration Cycle as a standalone DSH plugin (general-purpose workflow visualizer;...
2 versions - Latest release: 1 day ago - 1 maintainer
genkitx-promptfoo 0.1.13
Genkit AI framework plugin for Promptfoo.
14 versions - Latest release: about 2 years ago - 8 downloads last month - 7 stars on GitHub - 1 maintainer
@vieval/ui 0.11.1 💰
Web viewer server and API for vieval runs: live event bus, live tail of events.jsonl, and finishe...
19 versions - Latest release: 1 day ago - 4.8 thousand downloads last month - 71 stars on GitHub - 1 maintainer
@introspection-ai/cli 0.67.0
CLI for operating agents on the Introspection platform
100 versions - Latest release: 1 day ago - 4.21 thousand downloads last month - 2 maintainers