tool-scorer
Lightweight tool-call testing for LLM agents. Deterministic, local, zero API cost. Compare expected vs actual tool calls in 3 lines of Python. Supports OpenAI, Anthropic, Gemini.
Ecosystem
pypi.org
pypi.org
Latest Release
about 1 month ago
1.10.0
about 1 month ago
Versions
21
21
Downloads
19 last month
19 last month
Loading...
Readme
Loading...
Links
| Registry | pypi.org |
| Source | Repository |
| Homepage | Homepage |
| Docs | Documentation |
| JSON API | View JSON |
| CodeMeta | codemeta.json |
Package Details
| PURL |
pkg:pypi/tool-scorer
spec |
| License | Apache-2.0 |
| First Release | about 1 year ago |
| Last Synced | 30 days ago |
Keywords
agent-evaluation agent-testing ai-agents anthropic ci-cd evaluation function-calling gemini langchain langgraph llm llm-evaluation llm-testing mcp mcp-integration-testing mcp-server-quality mcp-server-testing mcp-testing openai pydantic-ai pytest snapshot-testing testing tool-calling tool-use ai-agents-and-tools llm-metrics metrics testing-framework
agent-evaluation agent-testing ai-agents anthropic ci-cd evaluation function-calling gemini langchain langgraph llm llm-evaluation llm-testing mcp mcp-integration-testing mcp-server-quality mcp-server-testing mcp-testing openai pydantic-ai pytest snapshot-testing testing tool-calling tool-use ai-agents-and-tools llm-metrics metrics testing-framework
Repository
| Stars | 5 on GitHub |
| Forks | 0 on GitHub |