Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

proxy.golang.org namespaces: github.com/llm-d

View the packages within the github.com/llm-d namespace on the proxy.golang.org package registry, including their maintainers and dependencies.

Top 5.5% on proxy.golang.org
github.com/llm-d/llm-d-inference-scheduler v0.3.2
Inference scheduler for llm-d
13 versions - Latest release: 19 days ago - 99 stars on GitHub
Top 5.4% on proxy.golang.org
github.com/llm-d/llm-d-inference-sim v0.5.1
A light weight vLLM simulator, for mocking out replicas.
16 versions - Latest release: about 1 month ago - 46 stars on GitHub
Top 5.7% on proxy.golang.org
github.com/llm-d/llm-d-kv-cache-manager v0.3.2
Distributed KV cache coordinator
10 versions - Latest release: 20 days ago - 75 stars on GitHub
Top 5.5% on proxy.golang.org
github.com/llm-d/llm-d-model-service v0.0.15
Simplified model deployment on llm-d
3 versions - Latest release: 5 months ago - 27 stars on GitHub