An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "Model Serving" keyword

View the packages on the pypi.org package registry that are tagged with the "Model Serving" keyword.

Top 2.2% on pypi.org
openllm 0.6.30
OpenLLM: Self-hosting LLMs Made Easy.
195 versions - Latest release: 5 months ago - 3 dependent packages - 295 dependent repositories - 8.47 thousand downloads last month - 8,657 stars on GitHub - 3 maintainers
Top 3.9% on pypi.org
openllm-client 0.5.7
OpenLLM Client: Interacting with OpenLLM HTTP/gRPC server, or any BentoML server.
85 versions - Latest release: about 1 year ago - 2 dependent packages - 8 dependent repositories - 453 downloads last month - 8,657 stars on GitHub - 1 maintainer
Top 3.5% on pypi.org
openllm-core 0.5.7
OpenLLM Core: Core components for OpenLLM.
85 versions - Latest release: about 1 year ago - 2 dependent packages - 8 dependent repositories - 1.36 thousand downloads last month - 8,657 stars on GitHub - 1 maintainer
Top 1.2% on pypi.org
bentoml 1.4.23
BentoML: The easiest way to serve AI apps and models
203 versions - Latest release: 3 days ago - 13 dependent packages - 499 dependent repositories - 106 thousand downloads last month - 6,591 stars on GitHub - 3 maintainers
genai_stack 0.2.6
End-to-End Secure & Private Generative AI for All
2 versions - Latest release: almost 2 years ago - 25 downloads last month - 125 stars on GitHub - 1 maintainer
bentoml-unsloth 0.1.2
BentoML: The easiest way to serve AI apps and models
3 versions - Latest release: 12 months ago - 125 downloads last month - 8,028 stars on GitHub - 1 maintainer
bentoml-core 0.1.0
The rust core of BentoML: The Unified Model Serving Framework
2 versions - Latest release: over 2 years ago - 39 downloads last month - 8,028 stars on GitHub - 2 maintainers
Top 3.6% on pypi.org
truss 0.60.0
A seamless bridge from model development to model delivery
813 versions - Latest release: 7 months ago - 2 dependent packages - 5 dependent repositories - 126 thousand downloads last month - 911 stars on GitHub - 6 maintainers
truss-lib 0.10.0rc3
A seamless bridge from model development to model delivery
4 versions - Latest release: 10 months ago - 20 downloads last month - 1,056 stars on GitHub - 1 maintainer
Top 6.5% on pypi.org
baseten 2.0.9
Deploy machine learning models to Baseten
115 versions - Latest release: almost 3 years ago - 2 dependent repositories - 1.46 thousand downloads last month - 4 maintainers
bentoml-plugins-arize 0.1.0
BentoML Monitoring Arize Plugin
1 version - Latest release: almost 3 years ago - 33 downloads last month - 6 stars on GitHub - 2 maintainers
aihero 0.5.1
AI Hero Python SDK
25 versions - Latest release: about 1 year ago - 145 downloads last month - 5 stars on GitHub - 1 maintainer
nidam 0.1.0
Nidam: Self-hosting LLMs Made Easy.
1 version - Latest release: 7 months ago - 14 downloads last month - 1 maintainer
onediffusion 0.0.3
Onediffusion: REST API server for running any diffusion models - Stable Diffusion, Anything, Cont...
3 versions - Latest release: almost 2 years ago - 32 downloads last month - 369 stars on GitHub - 2 maintainers
kcai-bentoml 1.0.20.post1 removed
BentoML: The Unified Model Serving Framework
4 versions - Latest release: about 2 years ago - 152 downloads last month - 1 maintainer