npmjs.org "evaluation" keyword
coolhand-node 0.18.0
Monitor and LLM API calls for analysis21 versions - Latest release: about 5 hours ago - 1.7 thousand downloads last month - 4 stars on GitHub - 1 maintainer
h4r5h4-langsmith 0.0.63
Client library to connect to the LangSmith LLM Tracing and Evaluation Platform.2 versions - Latest release: almost 3 years ago - 22 downloads last month - 1,082 stars on GitHub - 1 maintainer
@mlflow/qwen-code 0.4.0
Qwen Code integration package for MLflow Tracing3 versions - Latest release: 2 months ago - 100 downloads last month - 28,533 stars on GitHub - 1 maintainer
opik-ts 0.1.3
The Opik configure tool helps you to configure your Node.js project with Opik SDK1 version - Latest release: about 1 year ago - 21 downloads last month - 23,149 stars on GitHub - 1 maintainer
dsh-rubric 0.0.1
Scoring rubrics for agent work - name reserved; first release in development.1 version - Latest release: about 2 months ago - 0 downloads last month - 2 stars on GitHub - 1 maintainer
@mlflow/gemini 0.4.0
Gemini integration package for MLflow Tracing3 versions - Latest release: 2 months ago - 325 downloads last month - 28,630 stars on GitHub - 1 maintainer
openmerit 0.3.3
Evidence-driven model decisions for coding harnesses.29 versions - Latest release: about 6 hours ago - 3.15 thousand downloads last month - 2 maintainers
@tangle-network/playproof 0.10.0
Turn games into verifiable, cost-aware benchmarks for any agent.10 versions - Latest release: 2 months ago - 98 downloads last month - 0 stars on GitHub - 1 maintainer
@artemiskit/core 0.6.4
Core runner, evaluators, and storage for ArtemisKit LLM evaluation toolkit22 versions - Latest release: about 1 month ago - 2.85 thousand downloads last month - 7 stars on GitHub - 1 maintainer
@devilsdev/rag-pipeline-utils 3.6.0
Composable retrieval-augmented generation (RAG) for Node.js: grounded citations, evaluation, guar...41 versions - Latest release: about 11 hours ago - 2.93 thousand downloads last month - 1 stars on GitHub - 1 maintainer
@mlflow/mlflow-openclaw 0.2.0-rc.0
OpenClaw integration package for MLflow Tracing1 version - Latest release: 6 months ago - 37 downloads last month - 28,630 stars on GitHub - 1 maintainer
opik-vercel 2.2.142
Opik TypeScript and JavaScript SDK integration with Vercel AI SDK389 versions - Latest release: about 8 hours ago - 13 thousand downloads last month - 23,149 stars on GitHub - 1 maintainer
@mlflow/anthropic 0.4.0
Anthropic integration package for MLflow Tracing3 versions - Latest release: 2 months ago - 3.49 thousand downloads last month - 28,533 stars on GitHub - 1 maintainer
mlflow-openai 0.1.3
OpenAI integration package for MLflow Tracing5 versions - Latest release: 9 months ago - 3.55 thousand downloads last month - 28,533 stars on GitHub - 1 maintainer
@spechtlabs/sigil 0.8.3
The Sigil policy language in JavaScript: the Go engine compiled to WebAssembly, with typed bindings11 versions - Latest release: 22 days ago - 1.59 thousand downloads last month - 1 stars on GitHub - 1 maintainer
@mlflow/core 0.4.0
TypeScript implementation of MLflow Tracing SDK for LLM observability4 versions - Latest release: 2 months ago - 74 thousand downloads last month - 28,533 stars on GitHub - 1 maintainer
@rollyjoely/mlflow-anthropic 0.1.3
Anthropic integration package for MLflow Tracing2 versions - Latest release: 9 months ago - 20 downloads last month - 28,533 stars on GitHub - 1 maintainer
mlflow-vercel 0.1.1
Vercel AI SDK integration package for MLflow Tracing1 version - Latest release: 12 months ago - 12.2 thousand downloads last month - 28,533 stars on GitHub - 1 maintainer
@rollyjoely/mlflow-tracing 0.1.3
TypeScript implementation of MLflow Tracing SDK for LLM observability2 versions - Latest release: 9 months ago - 16 downloads last month - 28,630 stars on GitHub - 1 maintainer
@mlflow/vercel 0.4.0
Vercel AI SDK integration for MLflow Tracing — SpanProcessor that translates AI SDK span attribut...4 versions - Latest release: 2 months ago - 11.5 thousand downloads last month - 28,630 stars on GitHub - 1 maintainer
@serghei/tevu 0.1.0 💰
Task Evaluation & Verification Utility for AI coding agents3 versions - Latest release: 29 days ago - 424 downloads last month - 1 stars on GitHub - 1 maintainer
eva-install 0.7.0
Eva's command: installs the question bot into your web app, checks every link to a question on sc...8 versions - Latest release: about 7 hours ago - 170 downloads last month - 1 maintainer
hue-run 0.27.0
Alias of @hue-run/sdk. Install @hue-run/sdk directly; this package only re-exports it.19 versions - Latest release: 1 day ago - 747 downloads last month - 0 stars on GitHub - 1 maintainer
@hue-run/sdk 0.26.0
Hue OpenTelemetry helpers for Node.js agent applications62 versions - Latest release: 11 days ago - 89.5 thousand downloads last month - 0 stars on GitHub - 1 maintainer
@zenera/gym 1.1.56
Simulated API environments for agent training and evaluation, powered by OpenAPI and model-writte...20 versions - Latest release: about 10 hours ago - 3.22 thousand downloads last month - 8 stars on GitHub - 1 maintainer
@arizeai/phoenix-client 7.18.1
A client for the Phoenix API107 versions - Latest release: 1 day ago - 200 thousand downloads last month - 12,081 stars on GitHub - 5 maintainers
@coval/sdk 0.9.28
Typed TypeScript client for the Coval evaluation platform API.41 versions - Latest release: about 11 hours ago - 4.32 thousand downloads last month - 0 stars on GitHub - 5 maintainers
@drift_rail/sdk 2.7.0
DriftRail SDK - AI Safety & Observability Platform14 versions - Latest release: about 22 hours ago - 26 downloads last month - 1 maintainer
promptfoo 0.125.1 💰
LLM eval & testing toolkit427 versions - Latest release: 12 days ago - 1 dependent repositories - 3.59 million downloads last month - 26,850 stars on GitHub - 5 maintainers
@remnic/bench 9.69.56 💰
Retrieval latency ladder benchmarks + CI regression gates for @remnic/core659 versions - Latest release: 2 months ago - 8.19 thousand downloads last month - 230 stars on GitHub - 1 maintainer
@alexcarol/promptfoo 0.119.11 removed 💰
LLM eval & testing toolkit1 version - Latest release: 12 months ago - 9 downloads last month - 26,850 stars on GitHub - 1 maintainer
@devilsdev/rag-eval 3.6.0
RAG evaluation: faithfulness, relevance, context precision and recall, groundedness, datasets, re...6 versions - Latest release: about 11 hours ago - 436 downloads last month - 1 stars on GitHub - 1 maintainer
nanohype 0.1.3
The nanohype CLI — scaffold templates and composites from the nanohype catalog. Thin entry point ...2 versions - Latest release: about 1 month ago - 33 downloads last month - 2 stars on GitHub - 1 maintainer
@nanohype/sdk 0.3.0
Reference implementation of the nanohype template rendering contract, catalog discovery, and Plat...3 versions - Latest release: about 1 month ago - 105 downloads last month - 2 stars on GitHub - 1 maintainer
@nanohype/mcp 0.2.0
MCP server exposing the nanohype Platform Reference (catalog + standards + per-repo contracts) as...2 versions - Latest release: about 1 month ago - 49 downloads last month - 2 stars on GitHub - 1 maintainer
skillfid 0.2.7
Evaluate how faithfully agent skills apply their source documentation11 versions - Latest release: 1 day ago - 860 downloads last month - 1 stars on GitHub - 1 maintainer
opik 2.2.141
Opik TypeScript and JavaScript SDK607 versions - Latest release: about 11 hours ago - 143 thousand downloads last month - 23,149 stars on GitHub - 1 maintainer
@artemiskit/adapter-trueforge 0.1.12
TrueForge agent-harness adapter for ArtemisKit12 versions - Latest release: about 1 month ago - 71 downloads last month - 7 stars on GitHub - 1 maintainer
opik-gemini 2.2.141
Opik TypeScript and JavaScript SDK integration with Google Gemini AI388 versions - Latest release: about 11 hours ago - 19 thousand downloads last month - 23,149 stars on GitHub - 1 maintainer
@plune-ai/cli 0.33.0
AI-powered assertion testing for LLM apps — write assertions, run them against any provider, get ...44 versions - Latest release: about 11 hours ago - 13.5 thousand downloads last month - 0 stars on GitHub - 1 maintainer
mlflow-anthropic 0.1.3
Anthropic integration package for MLflow Tracing3 versions - Latest release: 9 months ago - 708 downloads last month - 28,533 stars on GitHub - 1 maintainer
@physionlabs/galileo 0.1.0-rc.3
Official Node.js and TypeScript client for the Galileo video evaluation API.8 versions - Latest release: 2 months ago - 908 downloads last month - 0 stars on GitHub - 1 maintainer
hupothesis 0.0.1
Time weighted evaluation engine middleware1 version - Latest release: over 10 years ago - 2 dependent packages - 1 dependent repositories - 12 downloads last month - 0 stars on GitHub - 1 maintainer
@mcpjam/inspector 3.18.0 💰
MCPJam Inspector308 versions - Latest release: 8 days ago - 56.6 thousand downloads last month - 2,297 stars on GitHub - 2 maintainers
web-codegen-scorer 0.0.70 deprecated
Web Codegen Scorer is a tool for evaluating the quality of web code generated by Large Language M...71 versions - Latest release: 7 months ago - 7.49 thousand downloads last month - 771 stars on GitHub - 1 maintainer
finch-jev 0.1.1
Structured evaluation with Jev (TypeSafe AI System One) — via TypeSafe's own API or OpenRouter.2 versions - Latest release: about 2 months ago - 74 stars on GitHub - 1 maintainer
@tpmjs/tools-judge 0.1.0
AI conversation quality judge. Evaluates AI SDK messages across 10 metrics with scores, reasoning...1 version - Latest release: 10 months ago - 13 downloads last month - 24 stars on GitHub - 1 maintainer
com.anupackages.debugconsole.expressions 1.0.1
Enable Expression evaluation for com.anupackages.debugconsole command line2 versions - Latest release: 2 months ago - 37 downloads last month - 0 stars on GitHub - 1 maintainer
@fluce/proctor 0.2.1
Agent-agnostic evaluation harness for coding agents and their plugins, skills and tools: test-fra...3 versions - Latest release: 1 day ago - 1 maintainer
mlflow-tracing 0.1.3
TypeScript implementation of MLflow Tracing SDK for LLM observability6 versions - Latest release: 9 months ago - 41.2 thousand downloads last month - 28,533 stars on GitHub - 1 maintainer
@qualweb/best-practices 0.7.13
QualWeb best practices114 versions - Latest release: 4 months ago - 3 dependent packages - 3 dependent repositories - 1.98 thousand downloads last month - 25 stars on GitHub - 4 maintainers
dsh-session-eval 0.4.1
Retrospective agent-session evaluation for DeepSeek Harness: deterministic grade cards from persi...9 versions - Latest release: about 15 hours ago - 1.02 thousand downloads last month - 0 stars on GitHub - 1 maintainer
dsh-judge 0.0.1
LLM-as-judge evaluation - name reserved; first release in development.1 version - Latest release: about 2 months ago - 15 downloads last month - 2 stars on GitHub - 1 maintainer
Top 9.6% on npmjs.org
78 versions - Latest release: about 2 months ago - 2 dependent packages - 3 dependent repositories - 1.9 thousand downloads last month - 25 stars on GitHub - 4 maintainers
@qualweb/wcag-techniques 0.4.9
Implementation of the WCAG 2.1 techniques78 versions - Latest release: about 2 months ago - 2 dependent packages - 3 dependent repositories - 1.9 thousand downloads last month - 25 stars on GitHub - 4 maintainers
@deranged/qualweb-best-practices 0.9.0
QualWeb best practices4 versions - Latest release: 6 months ago - 31 downloads last month - 25 stars on GitHub - 5 maintainers
@deranged/qualweb-wcag-techniques 0.6.0
Implementation of the WCAG 2.1 techniques5 versions - Latest release: 6 months ago - 96 downloads last month - 25 stars on GitHub - 5 maintainers
@orkestrel/study 0.0.10
Runs declared comparative studies with admitted requests, sealed execution custody, and independe...11 versions - Latest release: 2 days ago - 942 downloads last month - 0 stars on GitHub - 1 maintainer
@n8n/expression-runtime 0.37.5
Secure, isolated expression evaluation runtime for n8n83 versions - Latest release: 1 day ago - 780 thousand downloads last month - 209,559 stars on GitHub - 5 maintainers
@sublime.am/skill 2.1.1
Guide business needs to production-ready procedural agents on Sublime. Discover and validate the ...6 versions - Latest release: 1 day ago - 189 downloads last month - 1 stars on GitHub - 1 maintainer
truthy.js 0.6.1
Functions to simplify/normalize rules with the ability to leverage monads and applicative functor...4 versions - Latest release: almost 13 years ago - 4 dependent packages - 5 dependent repositories - 15 downloads last month - 1 maintainer
@razorwind/benchmark 0.0.37 💰
Razorwind plugin for evaluating design-system effectiveness with AI coding agents.34 versions - Latest release: 13 days ago - 3.29 thousand downloads last month - 0 stars on GitHub - 1 maintainer
@i18n-doctor/constants 0.10.2
Static constant evaluation for translation key resolution5 versions - Latest release: 2 months ago - 1.18 thousand downloads last month - 2 stars on GitHub - 1 maintainer
@artemiskit/cli 0.6.2
Command-line interface for ArtemisKit LLM evaluation toolkit25 versions - Latest release: about 1 month ago - 1.21 thousand downloads last month - 7 stars on GitHub - 1 maintainer
@artemiskit/reports 0.5.0
HTML report generation for ArtemisKit LLM evaluation toolkit22 versions - Latest release: about 1 month ago - 1.2 thousand downloads last month - 7 stars on GitHub - 1 maintainer
@artemiskit/sdk 0.6.3
Programmatic SDK for ArtemisKit LLM evaluation toolkit - integrate into your Node.js apps15 versions - Latest release: about 1 month ago - 1.65 thousand downloads last month - 7 stars on GitHub - 1 maintainer
@agentick/eval 0.15.4
Testing-shaped eval framework for Agentick. defineEval(...) returns a callable with runtime param...3 versions - Latest release: 3 months ago - 77 downloads last month - 7 stars on GitHub - 2 maintainers
@ops-ai/toggly-eval 2.1.1
Local feature-definition evaluation engine for Toggly server SDKs8 versions - Latest release: 18 days ago - 9.84 thousand downloads last month - 5 stars on GitHub - 2 maintainers
@mlflow/openai 0.4.0
OpenAI integration package for MLflow Tracing3 versions - Latest release: 2 months ago - 5.73 thousand downloads last month - 28,630 stars on GitHub - 1 maintainer
@seclai/cli 1.8.1
Seclai Command Line Interface — manage agents, knowledge bases, sources, memory banks, and more f...23 versions - Latest release: about 17 hours ago - 441 downloads last month - 2 stars on GitHub - 1 maintainer
opik-configure 0.1.2
The Opik configure tool helps you to configure your Node.js project with Opik SDK2 versions - Latest release: about 1 year ago - 54 downloads last month - 23,149 stars on GitHub - 1 maintainer
@coder/aegis-darwin-arm64 0.24.0
The darwin-arm64 aegis CLI binary for @coder/aegis38 versions - Latest release: about 17 hours ago - 0 downloads last month - 1 maintainer
langsmith-cai 0.0.63
Client library to connect to the LangSmith LLM Tracing and Evaluation Platform.1 version - Latest release: almost 3 years ago - 35 downloads last month - 1,082 stars on GitHub - 1 maintainer
@future-agi/sdk 0.2.0
We help GenAI teams maintain high-accuracy for their Models in production.4 versions - Latest release: about 18 hours ago - 49 downloads last month - 52 stars on GitHub - 3 maintainers
@ruvector/ruvllm 4.0.1
Bounded RuVLLM weight experiments, a durable GPU job loop with a Vast.ai host adapter, and verifi...21 versions - Latest release: about 23 hours ago - 444 thousand downloads last month - 4,604 stars on GitHub - 1 maintainer
@uipath/agent-sdk 1.205.0
SDK for the UiPath Agent Runtime API — evaluation execution and debug sessions.206 versions - Latest release: 2 days ago - 8.65 thousand downloads last month - 26 maintainers
opik-langchain 2.2.140
Opik TypeScript and JavaScript SDK integration with LangChain392 versions - Latest release: 1 day ago - 14 thousand downloads last month - 23,149 stars on GitHub - 1 maintainer
opik-openai 2.2.140
Opik TypeScript and JavaScript SDK integration with OpenAI388 versions - Latest release: 1 day ago - 12.1 thousand downloads last month - 23,149 stars on GitHub - 1 maintainer
@aegisai/opik 1.7.27-fork.1
Opik TypeScript and JavaScript SDK2 versions - Latest release: over 1 year ago - 15 downloads last month - 23,149 stars on GitHub - 1 maintainer
@ankhorage/rules 0.4.0 💰
Domain-agnostic rule engine and JSON configuration for Ankhorage.5 versions - Latest release: 1 day ago - 72.5 thousand downloads last month - 0 stars on GitHub - 1 maintainer
langwatch 2.2.0
LangWatch TypeScript/JavaScript SDK. Interact with the full LangWatch API and use the LangWatch O...83 versions - Latest release: 2 days ago - 133 thousand downloads last month - 5,011 stars on GitHub - 3 maintainers
@mupt-ai/dari-pareto 0.7.1
Static and interactive Pareto frontier plots for evaluation results.11 versions - Latest release: 1 day ago - 2.16 thousand downloads last month - 0 stars on GitHub - 2 maintainers
@noetic-tools/eval 1.3.0
Eval framework for Noetic agents: the describe/it/scorer suite runner, built-in and custom scorer...8 versions - Latest release: 2 days ago - 0 downloads last month - 18 stars on GitHub - 1 maintainer
@learning-commons/evaluators 1.3.0
TypeScript SDK for Learning Commons educational evaluators13 versions - Latest release: about 24 hours ago - 997 downloads last month - 86 stars on GitHub - 1 maintainer
@jtsang/jev-cli 0.3.0 💰
Command-line interface for TypeSafe AI's Jev evaluation model — evaluate typed questions against ...5 versions - Latest release: about 2 months ago - 985 downloads last month - 3 stars on GitHub - 1 maintainer
@mlflow/claude-code 0.4.0
Claude Code and Claude Agent SDK integration package for MLflow Tracing6 versions - Latest release: 2 months ago - 19.9 thousand downloads last month - 28,533 stars on GitHub - 1 maintainer
@coder/aegis 0.23.2
A/B testing for coding agents. Compare skills, prompts, models, and harnesses on task success, co...37 versions - Latest release: 2 days ago - 1.85 thousand downloads last month - 1 maintainer
opik-otel 2.2.140
Opik TypeScript and JavaScript SDK integration with OpenTelemetry232 versions - Latest release: 1 day ago - 7.03 thousand downloads last month - 23,149 stars on GitHub - 1 maintainer
@arizeai/phoenix-evals 2.7.1
A library for running evaluations for AI use cases40 versions - Latest release: 9 days ago - 54 thousand downloads last month - 12,081 stars on GitHub - 5 maintainers
mossbear 0.1.0-alpha.108
Durable, evolving artifacts that you and your coding agents write together — your rules, skills a...83 versions - Latest release: 1 day ago - 7.36 thousand downloads last month - 1 maintainer
@ixo/decision-oracle 0.2.29
Run an IXO evaluation oracle: pull claims, produce facts with your handlers, let the decision eng...31 versions - Latest release: 1 day ago - 2 maintainers
@avsbhq/core 1.7.0
Shared evaluation engine and types for the A vs B SDKs: flag evaluation, audiences, bucketing, an...7 versions - Latest release: 18 days ago - 716 downloads last month - 0 stars on GitHub - 1 maintainer
@cogitator-ai/evals 0.14.0
Evaluation framework for Cogitator AI agents24 versions - Latest release: 9 days ago - 69 downloads last month - 43 stars on GitHub - 1 maintainer
@orq-ai/evaluatorq 1.3.2
Evaluation framework with Effect-based architecture for running parallel AI evaluations29 versions - Latest release: 6 months ago - 910 downloads last month - 10 stars on GitHub - 2 maintainers
@mlflow/codex 0.4.0
Codex CLI integration package for MLflow Tracing4 versions - Latest release: 2 months ago - 2.05 thousand downloads last month - 28,630 stars on GitHub - 1 maintainer
@rollyjoely/mlflow-langchain 0.1.3
LangChain integration package for MLflow Tracing1 version - Latest release: 9 months ago - 165 downloads last month - 28,630 stars on GitHub - 1 maintainer
dreamd-mcp 1.2.2
Agent memory you can audit. Every lesson cites its source; trace a bad memory and remove it with ...14 versions - Latest release: 1 day ago - 863 downloads last month - 6 stars on GitHub - 1 maintainer
dsh-anic 0.56.0
ANIC — AI-Native Iteration Cycle as a standalone DSH plugin (general-purpose workflow visualizer;...2 versions - Latest release: 1 day ago - 1 maintainer
genkitx-promptfoo 0.1.13
Genkit AI framework plugin for Promptfoo.14 versions - Latest release: about 2 years ago - 8 downloads last month - 7 stars on GitHub - 1 maintainer
@vieval/ui 0.11.1 💰
Web viewer server and API for vieval runs: live event bus, live tail of events.jsonl, and finishe...19 versions - Latest release: 1 day ago - 4.8 thousand downloads last month - 71 stars on GitHub - 1 maintainer
@introspection-ai/cli 0.67.0
CLI for operating agents on the Introspection platform100 versions - Latest release: 1 day ago - 4.21 thousand downloads last month - 2 maintainers
Related Keywords
llm
807
typescript
506
cli
460
agents
428
mcp
416
ai-agents
410
ai
399
anthropic
386
rag
362
llmops
346
developer-tools
330
multi-agent
307
agentic-ai
306
bun
299
agent-framework
296
compiler
292
prompt-optimization
292
code-generation
291
slack-bot
288
apache-2-0
287
testing
254
benchmark
191
agent
153
eval
136
openai
133
observability
109
claude
96
evals
94
claude-code
91
llm-evaluation
87
prompt-engineering
82
tracing
68
javascript
61
langchain
59
model-context-protocol
56
open-source
55
prompt
52
regression
49
codex
44
sdk
43
opentelemetry
43
nodejs
42
deepseek-harness
42
dsh
41
ci
40
machine-learning
33
plugin
33
ai-agent
31
metrics
31
ai-governance
30
security
28
gpt
28
mcp-server
28
gemini
28
llm-observability
27
guardrails
27
ml
27
cursor
26
prompt-management
25
python
25
llm-as-judge
25
ai-safety
25
agent-evaluation
24
mlops
24
math
24
agent-skills
24
performance
23
validation
23
dsh-plugin
23
expression
22
benchmarking
21
scoring
21
coding-agents
21
statistics
21
memory
21
monitoring
21
parser
21
audit
20
graph
20
prompts
20
skills
19
agentops
19
safety
19
cordis
19
quality
19
apache-spark
18
prompt-injection
18
mlflow
18
llm-eval
18
model-management
18
copilot
18
react
18
mathematics
18
vitest
17
playground
17
lazy
17
harness
17
incremental
17
analytics
17
automation
17