npmjs.org "evals" keyword
View the packages on the npmjs.org package registry that are tagged with the "evals" keyword.
@mastra/deployer-cloudflare 0.13.4
A Cloudflare Workers deployer for Mastra applications.395 versions - Latest release: 2 days ago - 6.43 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/deployer-netlify 0.12.4
A Netlify deployer for Mastra applications.382 versions - Latest release: 2 days ago - 3.71 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/lance 0.3.0
Lance provider for Mastra - includes both vector and db storage capabilities95 versions - Latest release: 2 days ago - 2.37 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/deployer-cloud 0.16.0
A cloud-optimized deployer for Mastra applications with built-in telemetry, logging, and storage ...21 versions - Latest release: 2 days ago - 1.35 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
mastra 0.12.0
cli for mastra585 versions - Latest release: 2 days ago - 265 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/longmemeval 0.1.15
LongMemEval benchmark implementation for Mastra Memory100 versions - Latest release: 2 days ago - 3.67 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/cloudflare-d1 0.13.0
D1 provider for Mastra - includes db storage capabilities186 versions - Latest release: 2 days ago - 8.84 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/dane 0.0.50
Hey there! I'm Dane, and I'm excited to be your AI assistant and coding companion. I've created t...455 versions - Latest release: 2 days ago - 3.81 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/clickhouse 0.15.0
Clickhouse provider for Mastra - includes db storage capabilities220 versions - Latest release: 2 days ago - 2.5 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
create-mastra 0.12.0
Create Mastra apps with one command315 versions - Latest release: 2 days ago - 7.5 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/server 2.0.4
Typed HTTP handlers and utilities for exposing a `Mastra` instance over HTTP. This package powers...307 versions - Latest release: 4 months ago - 252 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/deployer-vercel 0.11.20
A Vercel deployer for Mastra applications.384 versions - Latest release: 2 days ago - 9.3 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/langfuse 0.0.6
Langfuse observability provider for Mastra - includes AI tracing and future observability features15 versions - Latest release: 2 days ago - 2.54 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/pg 0.15.0
Postgres provider for Mastra - includes both vector and db storage capabilities312 versions - Latest release: 2 days ago - 122 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/client-js 0.12.0
The official TypeScript library for the Mastra Client API371 versions - Latest release: 2 days ago - 108 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/braintrust 0.1.0
Braintrust observability provider for Mastra - includes AI tracing and future observability features5 versions - Latest release: 2 days ago - 158 downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/inngest 0.13.0
Mastra Inngest integration148 versions - Latest release: 2 days ago - 4.17 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/mcp-docs-server 0.13.18
MCP server for accessing Mastra.ai documentation, changelogs, and news.287 versions - Latest release: 2 days ago - 26.8 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/playground-ui 6.1.0
Mastra Playground components336 versions - Latest release: 2 days ago - 3.65 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/mongodb 0.14.0
MongoDB provider for Mastra - includes vector store capabilities172 versions - Latest release: 2 days ago - 6.74 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/deployer 0.16.0
Core deployment infrastructure for Mastra applications, handling build, packaging, and deployment...420 versions - Latest release: 2 days ago - 270 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/agent-builder 0.0.2
This package is currently experimental and only meant to be used internally to Mastra at the mome...13 versions - Latest release: 2 days ago - 712 downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/cloud 0.1.12
Official Mastra Cloud integration package for telemetry152 versions - Latest release: 2 days ago - 8.41 thousand downloads last month - 16,305 stars on GitHub - 11 maintainers
@mastra/core 0.16.0
Mastra is the Typescript framework for building AI agents and assistants. It’s used by some of th...490 versions - Latest release: 2 days ago - 572 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@gentrace/evals 0.0.3
Gentrace Evals plugin for Node.JS2 versions - Latest release: 9 months ago - 5 downloads last month - 3 stars on GitHub - 1 maintainer
@mastra/google-cloud-pubsub 0.1.3
Mastra Google Cloud PubSub integration13 versions - Latest release: 2 days ago - 632 downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/qdrant 0.11.10
Qdrant vector store provider for Mastra272 versions - Latest release: 2 days ago - 4.84 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/upstash 0.15.0
Upstash provider for Mastra - includes both vector and db storage capabilities303 versions - Latest release: 2 days ago - 7.83 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/libsql 0.14.0
Libsql provider for Mastra - includes both vector and db storage capabilities175 versions - Latest release: 2 days ago - 202 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/dynamodb 0.15.0
DynamoDB storage adapter for Mastra117 versions - Latest release: 2 days ago - 5.29 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/mssql 0.4.0
MSSQL provider for Mastra - db storage capabilities61 versions - Latest release: 2 days ago - 2.03 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/cloudflare 0.12.0
Cloudflare provider for Mastra - includes db storage capabilities224 versions - Latest release: 2 days ago - 6.64 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/mcp-registry-registry 0.10.13
MCP server for registry registry services.188 versions - Latest release: 2 days ago - 1.95 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/chroma 0.11.8
Chroma vector store provider for Mastra274 versions - Latest release: 2 days ago - 2.11 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/firecrawl 1.2.18
**⚠️ DEPRECATION NOTICE**: This package is deprecated. Please use [`firecrawl-mcp"`](https://www....376 versions - Latest release: 2 days ago - 2.47 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/voice-openai-realtime 0.11.4
Mastra OpenAI Realtime API integration222 versions - Latest release: 2 days ago - 4.64 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/voice-openai 0.11.4
Mastra OpenAI speech integration251 versions - Latest release: 2 days ago - 10.6 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/voice-sarvam 0.11.4
Mastra Sarvam AI voice integration214 versions - Latest release: 2 days ago - 1.93 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/voice-speechify 0.11.4
Mastra Speechify voice integration242 versions - Latest release: 2 days ago - 1.93 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/voice-playai 0.11.4
Mastra PlayAI voice integration245 versions - Latest release: 2 days ago - 2.06 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/voice-murf 0.11.4
Mastra Murf voice integration245 versions - Latest release: 2 days ago - 1.96 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/voice-google-gemini-live 0.10.10
Mastra Google Gemini Live API integration16 versions - Latest release: 2 days ago - 917 downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/voice-azure 0.10.11
Mastra Azure speech integration206 versions - Latest release: 2 days ago - 1.81 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/voice-gladia 0.11.4
Mastra Gladia AI voice integration73 versions - Latest release: 2 days ago - 1.74 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/voice-deepgram 0.11.4
Mastra Deepgram voice integration245 versions - Latest release: 2 days ago - 2.19 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/vectorize 0.11.9
Cloudflare Vectorize store provider for Mastra270 versions - Latest release: 2 days ago - 3.55 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/voice-cloudflare 0.11.4
Mastra Cloudflare AI voice integration210 versions - Latest release: 2 days ago - 1.96 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/voice-google 0.11.4
Mastra Google voice integration244 versions - Latest release: 2 days ago - 2.53 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/voice-elevenlabs 0.11.4
Mastra ElevenLabs voice integration244 versions - Latest release: 2 days ago - 2.68 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/turbopuffer 0.11.8
Turbopuffer vector store provider for Mastra222 versions - Latest release: 2 days ago - 1.82 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/astra 0.11.8
Astra DB provider for Mastra - includes vector store capabilities268 versions - Latest release: 2 days ago - 2.02 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/rag 1.2.4
The Retrieval-Augmented Generation (RAG) module contains document processing and embedding utilit...372 versions - Latest release: 2 days ago - 77.3 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/pinecone 0.11.8
Pinecone vector store provider for Mastra265 versions - Latest release: 2 days ago - 4.92 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/couchbase 0.11.8
Couchbase vector store provider for Mastra126 versions - Latest release: 2 days ago - 1.65 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/opensearch 0.11.9
OpenSearch vector store provider for Mastra106 versions - Latest release: 2 days ago - 2.16 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/mcp 0.11.4
Model Context Protocol (MCP) client implementation for Mastra, providing seamless integration wit...340 versions - Latest release: 2 days ago - 283 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/loggers 0.10.11
A collection of logging transport implementations for Mastra, extending the `LoggerTransport` cla...289 versions - Latest release: 2 days ago - 264 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/memory 0.14.4
Memory management for Mastra agents. Visit [the docs](https://mastra.ai/docs/agents/agent-memory)...380 versions - Latest release: 2 days ago - 246 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/evals 0.13.4
A comprehensive evaluation framework for assessing AI model outputs across multiple dimensions.315 versions - Latest release: 2 days ago - 51 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/ragie 1.2.12
**⚠️ DEPRECATION NOTICE**: This package is deprecated. Please use [`@ragieai/mcp-server`](https:/...332 versions - Latest release: 2 days ago - 1.79 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/github 1.2.12
**⚠️ DEPRECATION NOTICE**: This package is deprecated. Please use [Github MCP Server](https://git...343 versions - Latest release: 2 days ago - 2.21 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/mem0 0.1.12
Mem0 is a memory-based AI platform that allows you to store, search your memories based on the us...205 versions - Latest release: 2 days ago - 3.02 thousand downloads last month - 16,181 stars on GitHub - 11 maintainers
@mastra/ai-sdk 0.0.2
Adds custom API routes to be compatible with the AI SDK UI parts8 versions - Latest release: 2 days ago - 397 downloads last month - 16,181 stars on GitHub - 11 maintainers
@caleblawson/client-js 0.10.6-alpha.0
The official TypeScript library for the Mastra Client API1 version - Latest release: 3 months ago - 7 downloads last month - 16,181 stars on GitHub - 1 maintainer
evalite 0.11.5 💰
Test your LLM-powered apps with a TypeScript-native, Vitest-based eval runner. No API key required.36 versions - Latest release: 9 days ago - 45.1 thousand downloads last month - 822 stars on GitHub - 1 maintainer
@antoniel/evalite 0.8.6 💰
Test your LLM-powered apps with a TypeScript-native, Vitest-based eval runner. No API key required.3 versions - Latest release: 7 months ago - 34 downloads last month - 822 stars on GitHub - 1 maintainer
mcp-evals 2.0.1
GitHub Action for evaluating MCP server tool calls using LLM-based scoring21 versions - Latest release: 2 months ago - 82.4 thousand downloads last month - 87 stars on GitHub - 1 maintainer
@caleblawson/core 0.10.7-alpha.0
The core foundation of the Mastra framework, providing essential components and interfaces for bu...1 version - Latest release: 3 months ago - 2 downloads last month - 1 maintainer
benchmarkthing 0.0.1
Evals as an API - The easiest way to evaluate and benchmark AI models and systems1 version - Latest release: 9 months ago - 0 downloads last month - 1 maintainer
@arizeai/phoenix-evals 0.2.0
A library for running evaluations for AI use cases10 versions - Latest release: 14 days ago - 169 downloads last month - 7 maintainers
mastra-browser-core 0.0.15
The core foundation of the Mastra framework, providing essential components and interfaces for bu...13 versions - Latest release: 5 months ago - 57 downloads last month - 1 maintainer
@glyphyai/mastra-core 0.7.0
The core foundation of the Mastra framework, providing essential components and interfaces for bu...9 versions - Latest release: 5 months ago - 22 downloads last month - 1 maintainer
mandoline 0.5.0
Official Node.js client for the Mandoline API9 versions - Latest release: 19 days ago - 94 downloads last month - 2 stars on GitHub - 1 maintainer
@modelmetry/sdk 1.0.1
The Modelmetry JS/Ts SDK allows developers to easily integrate Modelmetry's advanced guardrails a...17 versions - Latest release: 7 months ago - 24 downloads last month - 1 stars on GitHub - 1 maintainer
mastra_core 0.0.2
The core foundation of the Mastra framework, providing essential components and interfaces for bu...4 versions - Latest release: 4 months ago - 14 downloads last month - 1 maintainer
eval-genius 0.1.2
eval-genius enables evals of arbitrary async code. It is generally intended for making multiple a...31 versions - Latest release: about 1 month ago - 2.32 thousand downloads last month - 2 stars on GitHub - 1 maintainer
evalz 0.2.2
Model graded evals with typescript17 versions - Latest release: 9 months ago - 303 downloads last month - 152 stars on GitHub - 1 maintainer
@hamming/hamming-sdk 1.0.27
SDK for Hamming Evals Framework28 versions - Latest release: 11 months ago - 335 downloads last month - 1 stars on GitHub - 1 maintainer
@hamming/hamming-langchain 1.0.0
Langchain Integration for Hamming SDK1 version - Latest release: about 1 year ago - 6 downloads last month - 0 stars on GitHub - 1 maintainer
evals 1.0.7
Umbrage Evals CLI14 versions - Latest release: over 1 year ago - 22 downloads last month - 1 maintainer
@wavequery/conductor 0.0.24
Modular LLM orchestration framework6 versions - Latest release: 10 months ago - 26 downloads last month - 4 stars on GitHub - 1 maintainer
Related Keywords
llm
77
ai
75
typescript
70
agents
67
mcp
64
nodejs
64
workflows
63
tts
63
reactjs
63
nextjs
63
javascript
63
chatbots
63
agent
9
mastra
8
llms
8
vectorstore
6
embeddings
6
rag
6
framework
5
otel
5
opentelemetry
5
telemetry
5
tools
5
memory
5
evaluation
5
speech-recognition
3
speech-to-text
3
stt
3
cli
3
testing
2
text-to-speech
2
vitest
2
openai
2
websocket
1
wavequery
1
github-actions
1
ml
1
benchmark
1
chatgpt
1
phoenix
1
mandoline
1
api
1
metrics
1
evaluations
1
chat
1
visualization
1
transformers
1
ai-observability
1
anthropic
1
guardrails
1
large-language-models
1
d3
1
orchestration
1
umbrage
1
zod
1
streaming
1
structured output
1
eval
1
tracing
1
llm-observability
1
monitoring
1
observability
1
ai-sdk
1
project
1
scaffold
1
generator
1
init
1
template
1
boilerplate
1
starter
1
create
1
devtools
1
command-line
1
workflow
1
build
1
deployment
1
deploy
1
development
1
dev
1
chunking
1
text-splitting
1
semantic-search
1
document-processing
1
embedding
1
vector-search
1
retrieval-augmented-generation
1
open-source
1
cloudflare
1
gladia
1
indian-languages
1
sarvam
1
gentrace
1
builder
1
components
1
playground
1