npmjs.org "evaluation" keyword
clientcoded 0.5.0
ClientCoded SDK - Trace your AI agent's tool calls for root cause analysis4 versions - Latest release: about 2 hours ago - 24 downloads last month - 0 stars on GitHub - 1 maintainer
@n8n/expression-runtime 0.35.0
Secure, isolated expression evaluation runtime for n8n69 versions - Latest release: 11 days ago - 794 thousand downloads last month - 208,194 stars on GitHub - 5 maintainers
@stdlib/stats-incr-rmse 0.2.3 π°
Compute the root mean squared error (RMSE) incrementally.13 versions - Latest release: 9 months ago - 3 dependent packages - 3 dependent repositories - 303 downloads last month - 1 stars on GitHub - 4 maintainers
@ssheleg/agent-stack 0.31.0
Production patterns for AI agent orchestrators β tool-calling loops, multi-stage pipelines with c...59 versions - Latest release: about 6 hours ago - 1.88 thousand downloads last month - 4 stars on GitHub - 1 maintainer
@dailephd/my-dev-kit-lab 0.9.4 π°
Evidence, benchmark, and evaluation companion for my-dev-kit.36 versions - Latest release: about 7 hours ago - 3.88 thousand downloads last month - 0 stars on GitHub - 1 maintainer
@orkestrel/study 0.0.3
Runs declared comparative studies with admitted requests, sealed execution custody, and independe...4 versions - Latest release: about 9 hours ago - 0 stars on GitHub - 1 maintainer
@opensearch-project/agent-health 0.8.1
Agent Evaluation and Observability Framework11 versions - Latest release: 1 day ago - 580 downloads last month - 35 stars on GitHub - 3 maintainers
langsmith-cai 0.0.63
Client library to connect to the LangSmith LLM Tracing and Evaluation Platform.1 version - Latest release: over 2 years ago - 35 downloads last month - 1,082 stars on GitHub - 1 maintainer
h4r5h4-langsmith 0.0.63
Client library to connect to the LangSmith LLM Tracing and Evaluation Platform.2 versions - Latest release: over 2 years ago - 34 downloads last month - 1,082 stars on GitHub - 1 maintainer
@covalai/mcp-server 0.1.0
Coval MCP Server - AI evaluation platform integration for Claude Desktop, Cursor, and other MCP c...1 version - Latest release: 8 months ago - 8 downloads last month - 3 stars on GitHub - 1 maintainer
@coval/mcp-server 0.4.1
Coval MCP Server - AI evaluation platform integration for Claude Desktop, Cursor, and other MCP c...4 versions - Latest release: 4 days ago - 56 downloads last month - 3 stars on GitHub - 5 maintainers
@coval/sdk 0.7.2
Typed TypeScript client for the Coval evaluation platform API.16 versions - Latest release: 4 days ago - 1.66 thousand downloads last month - 2 stars on GitHub - 5 maintainers
coolhand-node 0.17.1
Monitor and LLM API calls for analysis20 versions - Latest release: about 12 hours ago - 1.75 thousand downloads last month - 4 stars on GitHub - 1 maintainer
@trustmodel/local 0.1.0
Score any AI for trust β 100% local, no API key. Eval / Monitor / Govern across 10 trust dimensio...1 version - Latest release: 2 months ago - 12 downloads last month - 0 stars on GitHub - 2 maintainers
agent-regression-testing 0.2.3
A standalone library for AI agent regression testing using LLM-as-judge evaluation14 versions - Latest release: about 14 hours ago - 1.09 thousand downloads last month - 0 stars on GitHub - 1 maintainer
tracepad 0.1.0
Tracing, prompts, scores and evals for Node LLM apps, on OpenTelemetry β the client for Tracepad,...3 versions - Latest release: 18 days ago - 385 downloads last month - 1 stars on GitHub - 1 maintainer
@drift_rail/sdk 2.4.1
DriftRail SDK - AI Safety & Observability Platform9 versions - Latest release: about 14 hours ago - 26 downloads last month - 1 maintainer
@alexcarol/promptfoo 0.119.11 removed π°
LLM eval & testing toolkit1 version - Latest release: 11 months ago - 9 downloads last month - 25,988 stars on GitHub - 1 maintainer
@arizeai/phoenix-client 7.16.2
A client for the Phoenix API103 versions - Latest release: 2 days ago - 294 thousand downloads last month - 11,874 stars on GitHub - 5 maintainers
promptfoo 0.124.1 π°
LLM eval & testing toolkit425 versions - Latest release: 16 days ago - 1 dependent repositories - 3.55 million downloads last month - 26,224 stars on GitHub - 5 maintainers
@arizeai/phoenix-evals 2.7.0
A library for running evaluations for AI use cases39 versions - Latest release: 2 days ago - 152 thousand downloads last month - 11,874 stars on GitHub - 5 maintainers
@uipath/agent-sdk 1.204.0
SDK for the UiPath Agent Runtime API β evaluation execution and debug sessions.185 versions - Latest release: 4 days ago - 9.79 thousand downloads last month - 26 maintainers
@pharmatools/opengate-mcp 0.1.4 π°
MCP server for OpenGATE β let an AI agent check whether its answers are grounded in the provided ...5 versions - Latest release: 4 months ago - 153 downloads last month - 1 stars on GitHub - 1 maintainer
eva-install 0.5.0
Eva's command: installs the question bot into your web app, checks every link to a question on sc...4 versions - Latest release: about 15 hours ago - 170 downloads last month - 1 maintainer
mlflow-anthropic 0.1.3
Anthropic integration package for MLflow Tracing3 versions - Latest release: 9 months ago - 822 downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/codex 0.4.0
Codex CLI integration package for MLflow Tracing4 versions - Latest release: about 2 months ago - 1.02 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
mlflow-tracing 0.1.3
TypeScript implementation of MLflow Tracing SDK for LLM observability6 versions - Latest release: 9 months ago - 35.1 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
mlflow-vercel 0.1.1
Vercel AI SDK integration package for MLflow Tracing1 version - Latest release: 12 months ago - 2.16 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/anthropic 0.4.0
Anthropic integration package for MLflow Tracing3 versions - Latest release: about 2 months ago - 1.17 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/openai 0.4.0
OpenAI integration package for MLflow Tracing3 versions - Latest release: about 2 months ago - 5.24 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
mlflow-openai 0.1.3
OpenAI integration package for MLflow Tracing5 versions - Latest release: 9 months ago - 3.63 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/vercel 0.4.0
Vercel AI SDK integration for MLflow Tracing β SpanProcessor that translates AI SDK span attribut...4 versions - Latest release: about 2 months ago - 12.2 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
@rollyjoely/mlflow-langchain 0.1.3
LangChain integration package for MLflow Tracing1 version - Latest release: 8 months ago - 151 downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/core 0.4.0
TypeScript implementation of MLflow Tracing SDK for LLM observability4 versions - Latest release: about 2 months ago - 74.6 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
mlflow-gemini 0.1.3
Gemini integration package for MLflow Tracing3 versions - Latest release: 9 months ago - 15 downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/mlflow-openclaw 0.2.0-rc.0
OpenClaw integration package for MLflow Tracing1 version - Latest release: 6 months ago - 40 downloads last month - 28,439 stars on GitHub - 1 maintainer
@typia/jev 15.1.0 π°
Jev evaluation model integration for typia5 versions - Latest release: 21 days ago - 785 downloads last month - 5,948 stars on GitHub - 1 maintainer
@rollyjoely/mlflow-tracing 0.1.3
TypeScript implementation of MLflow Tracing SDK for LLM observability2 versions - Latest release: 8 months ago - 14 downloads last month - 28,439 stars on GitHub - 1 maintainer
@rollyjoely/mlflow-anthropic 0.1.3
Anthropic integration package for MLflow Tracing2 versions - Latest release: 8 months ago - 10 downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/qwen-code 0.4.0
Qwen Code integration package for MLflow Tracing3 versions - Latest release: about 2 months ago - 114 downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/claude-code 0.4.0
Claude Code and Claude Agent SDK integration package for MLflow Tracing6 versions - Latest release: about 2 months ago - 22.8 thousand downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/opencode 0.4.0
OpenCode integration package for MLflow Tracing3 versions - Latest release: about 2 months ago - 206 downloads last month - 28,439 stars on GitHub - 1 maintainer
@mlflow/gemini 0.4.0
Gemini integration package for MLflow Tracing3 versions - Latest release: about 2 months ago - 169 downloads last month - 28,439 stars on GitHub - 1 maintainer
llm-judge 1.0.0
CLI tool for evaluating artifacts with LLMs β Swiss Elo ranking, pass/gate, and qualitative review1 version - Latest release: 6 months ago - 19 downloads last month - 0 stars on GitHub - 1 maintainer
Top 9.8% on npmjs.org
109 versions - Latest release: about 1 month ago - 3 dependent packages - 1 dependent repositories - 4.66 thousand downloads last month - 25 stars on GitHub - 1 maintainer
fig-tree-evaluator 2.23.2
Module to evaluate JSON-structured expression trees109 versions - Latest release: about 1 month ago - 3 dependent packages - 1 dependent repositories - 4.66 thousand downloads last month - 25 stars on GitHub - 1 maintainer
@dynatrace-oss/dt-eval-lib 0.0.21-alpha
Minimal TypeScript library for running LLM-as-a-judge evaluations13 versions - Latest release: about 18 hours ago - 7.53 thousand downloads last month - 51 stars on GitHub - 2 maintainers
@trustmodel/sdk 0.4.0
Official TypeScript/Node SDK for TrustModel β AI trust evaluation, OTel telemetry, and agent gove...9 versions - Latest release: about 18 hours ago - 101 downloads last month - 2 stars on GitHub - 1 maintainer
57b-agenteval 0.3.0
Model and workflow evaluation harness conforming to the Agent Evaluation Protocol v0.43 versions - Latest release: about 18 hours ago - 1 maintainer
skillgrade 0.5.0
The easiest way to evaluate your Agent Skills and AI agents β test that AI agents correctly disco...15 versions - Latest release: 12 days ago - 738 downloads last month - 729 stars on GitHub - 1 maintainer
@kmonty/skillgrade 0.1.17
The easiest way to evaluate your Agent Skills β test that AI agents correctly discover and use yo...18 versions - Latest release: 6 months ago - 21 downloads last month - 729 stars on GitHub - 2 maintainers
@mcpjam/inspector 3.16.2 π°
MCPJam Inspector306 versions - Latest release: 4 days ago - 38.8 thousand downloads last month - 2,266 stars on GitHub - 2 maintainers
@fre4x/benchmark 1.1.29
A deterministic benchmark MCP server for agent evaluation workflows.18 versions - Latest release: about 22 hours ago - 231 downloads last month - 1 maintainer
@thomasfosterau/effect-evals 0.5.1
An Effect-native LLM evaluation toolkit β goldens, scorers, thresholds, metrics (G-Eval, RAG, ret...10 versions - Latest release: about 23 hours ago - 1.34 thousand downloads last month - 1 stars on GitHub - 1 maintainer
@gnldev/evals 0.14.0
Scorers + LLM-judge for @gnldev/durable. scoreRun reads the journal trace β deterministic, replay...16 versions - Latest release: about 23 hours ago - 2.17 thousand downloads last month - 2 stars on GitHub - 1 maintainer
@gnldev/semantic-qualify 0.14.0
Qualification bench for GNL's semantic judge: measures a judge closure against blind fixtures and...16 versions - Latest release: about 22 hours ago - 2.05 thousand downloads last month - 2 stars on GitHub - 1 maintainer
Top 2.2% on npmjs.org
3 versions - Latest release: over 5 years ago - 505 dependent packages - 1,174,541 dependent repositories - 434 million downloads last month - 67 stars on GitHub - 1 maintainer
define-lazy-prop 3.0.0 π°
Define a lazily evaluated property on an object3 versions - Latest release: over 5 years ago - 505 dependent packages - 1,174,541 dependent repositories - 434 million downloads last month - 67 stars on GitHub - 1 maintainer
dsh-session-eval 0.3.0
Retrospective agent-session evaluation for DeepSeek Harness: deterministic grade cards from persi...7 versions - Latest release: 1 day ago - 1.11 thousand downloads last month - 0 stars on GitHub - 1 maintainer
@razorwind/benchmark 0.0.34 π°
Razorwind plugin for evaluating design-system effectiveness with AI coding agents.31 versions - Latest release: 2 days ago - 3.4 thousand downloads last month - 0 stars on GitHub - 1 maintainer
@holonograph/types-public 0.17.0
Public wire-format types and zod schemas for a Holonograph lens β the shared contract between the...13 versions - Latest release: 1 day ago - 627 downloads last month - 1 maintainer
@holonograph/client 0.17.0
TypeScript HTTP client for a Holonograph lens. Send messages through the lens and report scored o...20 versions - Latest release: 1 day ago - 661 downloads last month - 0 stars on GitHub - 1 maintainer
@remnic/bench 9.69.56 π°
Retrieval latency ladder benchmarks + CI regression gates for @remnic/core602 versions - Latest release: about 2 months ago - 5.47 thousand downloads last month - 228 stars on GitHub - 1 maintainer
@plune-ai/cli 0.30.0
AI-powered assertion testing for LLM apps β write assertions, run them against any provider, get ...37 versions - Latest release: 1 day ago - 8.7 thousand downloads last month - 0 stars on GitHub - 1 maintainer
@ixo/decision-oracle 0.2.22
Run an IXO evaluation oracle: pull claims, produce facts with your handlers, let the decision eng...24 versions - Latest release: 2 days ago - 2 maintainers
@frontierharness/eval 0.0.2
Benchmark your own coding-agent harness against FrontierHarness Eval: sets up the benchmark works...2 versions - Latest release: about 2 months ago - 99 downloads last month - 316 stars on GitHub - 2 maintainers
pi-autocontext 0.10.0
autocontext extension for Pi coding agent β iterative strategy generation, LLM judging, and evalu...11 versions - Latest release: 2 months ago - 142 downloads last month - 1,310 stars on GitHub - 1 maintainer
autoctx 0.19.0
autocontext β always-on agent evaluation harness46 versions - Latest release: 26 days ago - 1.29 thousand downloads last month - 1,310 stars on GitHub - 1 maintainer
modelcheck-cli 0.2.0
Local regression testing for AI applications: baseline, verify and compare model or configuration...4 versions - Latest release: 1 day ago - 0 stars on GitHub - 1 maintainer
opik-openai 2.2.117
Opik TypeScript and JavaScript SDK integration with OpenAI365 versions - Latest release: 1 day ago - 10.7 thousand downloads last month - 22,776 stars on GitHub - 1 maintainer
opik 2.2.117
Opik TypeScript and JavaScript SDK583 versions - Latest release: 1 day ago - 147 thousand downloads last month - 22,776 stars on GitHub - 1 maintainer
opik-otel 2.2.117
Opik TypeScript and JavaScript SDK integration with OpenTelemetry209 versions - Latest release: 1 day ago - 5.98 thousand downloads last month - 22,776 stars on GitHub - 1 maintainer
opik-gemini 2.2.116
Opik TypeScript and JavaScript SDK integration with Google Gemini AI363 versions - Latest release: 1 day ago - 14.3 thousand downloads last month - 22,776 stars on GitHub - 1 maintainer
opik-langchain 2.2.116
Opik TypeScript and JavaScript SDK integration with LangChain368 versions - Latest release: 1 day ago - 13.2 thousand downloads last month - 22,776 stars on GitHub - 1 maintainer
opik-vercel 2.2.116
Opik TypeScript and JavaScript SDK integration with Vercel AI SDK363 versions - Latest release: 1 day ago - 13.5 thousand downloads last month - 22,776 stars on GitHub - 1 maintainer
wyrd-ai 0.3.0
TypeScript SDK for Wyrd: verification and assurance for AI systems.5 versions - Latest release: 1 day ago - 2 stars on GitHub - 1 maintainer
dsh-eval-guard 0.7.2
Evaluation guard for DSH: workspace-only filesystem, no network/subagents, wall-clock limits, and...24 versions - Latest release: 3 days ago - 1.62 thousand downloads last month - 0 stars on GitHub - 1 maintainer
@sbissoli/mcp-evals 0.2.2
Harness de evals para servidores MCP: seleΓ§Γ£o de tool em turno ΓΊnico (catΓ‘logo, fixtures, scorer,...5 versions - Latest release: 16 days ago - 2.17 thousand downloads last month - 1 stars on GitHub - 1 maintainer
mongodb-assistant-eval 0.1.1
Evaluation library for the MongoDB Assistant API.8 versions - Latest release: 1 day ago - 39.3 thousand downloads last month - 2 maintainers
@goyamegh/agent-health 0.5.23
Agent Evaluation and Observability Framework83 versions - Latest release: 4 months ago - 278 downloads last month - 35 stars on GitHub - 1 maintainer
@magland/gentl 0.1.0
A readability test for codebases: a memoryless agent carries out a newcomer task and gentl measur...2 versions - Latest release: 1 day ago - 1 maintainer
@dataprime1/dreamd 0.0.0 deprecated
Portable memory layer for AI coding agents β pre-release1 version - Latest release: 6 months ago - 12 downloads last month - 5 stars on GitHub - 1 maintainer
dreamd-mcp 1.0.1
Local-first memory for AI coding agents. One .agent/ folder shared by Claude Code, Cursor and Cli...11 versions - Latest release: 1 day ago - 367 downloads last month - 5 stars on GitHub - 1 maintainer
@fulllifegames/eval-engine 0.7.1
Position evaluation for PokΓ©mon Showdown replays: reconstruction, search, per-turn analysis, and ...2 versions - Latest release: about 2 months ago - 293 downloads last month - 0 stars on GitHub - 1 maintainer
@swissspidy/belay-calibrate 0.1.1 π°
Calibrate Belay task thresholds on labeled data in a real Chrome: CLI, calibration file and HTML ...3 versions - Latest release: 15 days ago - 0 stars on GitHub - 1 maintainer
viteval 0.5.9 π°
Next generation LLM evaluation framework powered by Vitest.32 versions - Latest release: 7 months ago - 7.49 thousand downloads last month - 51 stars on GitHub - 1 maintainer
@smthrs/evals 1.0.0-rc.3
Fixed-suite evaluation, baselines, regression reports, and score gates for flows13 versions - Latest release: 14 days ago - 457 downloads last month - 439 stars on GitHub - 1 maintainer
@auraone/github-app 1.0.0
GitHub App for automated AuraOne evaluations on pull requests3 versions - Latest release: 5 days ago - 62 downloads last month - 0 stars on GitHub - 1 maintainer
@auraone/sdk 1.0.0
Official TypeScript SDK for AuraOne API - Comprehensive AI platform for training, analytics, and ...8 versions - Latest release: 5 days ago - 113 downloads last month - 0 stars on GitHub - 1 maintainer
@spechtlabs/sigil 0.8.3
The Sigil policy language in JavaScript: the Go engine compiled to WebAssembly, with typed bindings11 versions - Latest release: 9 days ago - 1.59 thousand downloads last month - 1 stars on GitHub - 1 maintainer
@pauly4010/evalai-sdk 1.9.1
AI Evaluation Platform SDK - Complete API Coverage with Performance Optimizations13 versions - Latest release: 8 months ago - 103 downloads last month - 0 stars on GitHub - 1 maintainer
@ragbits/api-client 1.6.2
JavaScript client for the Ragbits API23 versions - Latest release: 7 months ago - 39 downloads last month - 1,678 stars on GitHub - 2 maintainers
@ragbits/api-client-react 1.6.2
React hooks for the Ragbits API client21 versions - Latest release: 7 months ago - 37 downloads last month - 1,678 stars on GitHub - 2 maintainers
@learning-commons/evaluators 1.2.0
TypeScript SDK for Learning Commons educational evaluators12 versions - Latest release: 9 days ago - 1.06 thousand downloads last month - 86 stars on GitHub - 1 maintainer
mossbear 0.1.0-alpha.96
Durable, evolving artifacts that you and your coding agents write together β your rules, skills a...71 versions - Latest release: 2 days ago - 8.39 thousand downloads last month - 1 maintainer
@hikae/jev-algorithms 0.3.0
Runtime-agnostic algorithms built on TypeSafe's Jev structured-evaluation model.4 versions - Latest release: about 1 month ago - 397 downloads last month - 0 stars on GitHub - 1 maintainer
@woocommerce/expression-evaluation 2.0.0
Library for evaluating expressions.2 versions - Latest release: 4 months ago - 1 dependent package - 45 downloads last month - 10,558 stars on GitHub - 9 maintainers
judgeval 1.3.5
JavaScript/TypeScript client for Judgment evaluation platform57 versions - Latest release: 15 days ago - 155 thousand downloads last month - 5 stars on GitHub - 2 maintainers
quantum-reasoning-skill 1.1.5
Quantum-inspired reasoning skill for exploring multiple solution paths7 versions - Latest release: 10 days ago - 719 downloads last month - 3 stars on GitHub - 1 maintainer
@galaxy-foundry/gxwf-pi-harness 0.4.2
Pi-backed isolated worker runner and extension for testing Galaxy Workflow Foundry skills.6 versions - Latest release: 7 days ago - 335 downloads last month - 3 stars on GitHub - 1 maintainer
@atlasauth/pca-control-evals 0.4.1
Empirical adversarial control-evaluation harness for PCA: a seeded red-team/blue-team game (Redwo...6 versions - Latest release: 12 days ago - 0 stars on GitHub - 1 maintainer
@langwatch/server 3.21.0
Run LangWatch locally with one command β `npx @langwatch/server`. Complete LangWatch stack: obser...55 versions - Latest release: 2 days ago - 2.22 thousand downloads last month - 4,981 stars on GitHub - 3 maintainers
Related Keywords
llm
792
typescript
498
cli
454
agents
423
mcp
405
ai-agents
403
ai
392
anthropic
384
rag
356
llmops
345
developer-tools
330
multi-agent
307
agentic-ai
302
bun
299
agent-framework
296
compiler
292
prompt-optimization
292
code-generation
291
slack-bot
288
apache-2-0
287
testing
249
benchmark
182
agent
148
eval
134
openai
132
observability
107
claude
93
evals
90
claude-code
85
llm-evaluation
85
prompt-engineering
80
tracing
67
javascript
59
langchain
59
open-source
54
model-context-protocol
54
prompt
48
sdk
43
regression
42
nodejs
39
ci
39
codex
38
deepseek-harness
36
dsh
35
opentelemetry
34
machine-learning
33
plugin
32
metrics
31
ai-agent
30
ai-governance
29
gpt
28
mcp-server
28
gemini
28
security
27
llm-observability
27
ml
26
guardrails
25
math
25
prompt-management
24
agent-skills
24
agent-evaluation
24
performance
23
mlops
23
python
23
validation
23
expression
23
llm-as-judge
23
parser
22
monitoring
21
scoring
21
benchmarking
21
prompts
20
agentops
19
cordis
19
graph
19
audit
19
safety
19
quality
19
ai-safety
18
prompt-injection
18
skills
18
react
18
llm-eval
18
model-management
18
mathematics
18
mlflow
18
copilot
18
apache-spark
18
vitest
17
coding-agents
17
analytics
17
incremental
17
dsh-plugin
17
harness
17
playground
17
lazy
17
statistics
17
automation
17
cursor
17
llama-index
16