Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "model-inference" keyword

Top 3.9% on pypi.org
openllm-client 0.4.44
OpenLLM Client: Interacting with OpenLLM HTTP/gRPC server, or any BentoML server.
74 versions - Latest release: 4 months ago - 2 dependent packages - 8 dependent repositories - 13.7 thousand downloads last month - 8,657 stars on GitHub - 1 maintainer
Top 2.2% on pypi.org
openllm 0.4.44
OpenLLM: Operating LLMs in production
153 versions - Latest release: 4 months ago - 3 dependent packages - 295 dependent repositories - 16.8 thousand downloads last month - 8,657 stars on GitHub - 2 maintainers
Top 3.5% on pypi.org
openllm-core 0.4.44
OpenLLM Core: Core components for OpenLLM.
74 versions - Latest release: 4 months ago - 2 dependent packages - 8 dependent repositories - 13.9 thousand downloads last month - 8,657 stars on GitHub - 1 maintainer
rungpt 0.1.1
An open-source cloud-native of large multi-modal models (LMMs) serving framework.
2 versions - Latest release: 9 months ago - 43 downloads last month - 134 stars on GitHub - 1 maintainer
clip-api-service 0.1.3
Build AI applications with any CLIP models - embed image and sentences, object recognition, visua...
3 versions - Latest release: 7 months ago - 50 downloads last month - 36 stars on GitHub - 2 maintainers
bentoml-core 0.1.0
The rust core of BentoML: The Unified Model Serving Framework
2 versions - Latest release: 12 months ago - 35 downloads last month - 6,591 stars on GitHub - 2 maintainers
open-gpt-torch 0.0.13
An open-source cloud-native of large multi-modal models (LMMs) serving framework.
27 versions - Latest release: 10 months ago - 127 downloads last month - 134 stars on GitHub - 1 maintainer
yatai 0.0.1
Model and deployment management for BentoML
1 version - Latest release: almost 3 years ago - 1 dependent repositories - 32 downloads last month - 6,591 stars on GitHub - 1 maintainer
edge-tpu-silva 1.0.5
Streamlining the process for seamless execution of PyCoral in running TensorFlow Lite models on a...
4 versions - Latest release: 2 months ago - 319 downloads last month - 2 stars on GitHub - 1 maintainer
sentencebertservice 20211205152102
BentoML generated model module
1 version - Latest release: over 2 years ago - 1 dependent repositories - 26 downloads last month - 6,591 stars on GitHub - 1 maintainer