Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "model-inference" keyword

Top 2.2% on pypi.org
openllm 0.4.44
OpenLLM: Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in...
161 versions - Latest release: 4 months ago - 3 dependent packages - 295 dependent repositories - 16.6 thousand downloads last month - 8,657 stars on GitHub - 2 maintainers
Top 3.5% on pypi.org
openllm-core 0.4.44
OpenLLM Core: Core components for OpenLLM.
82 versions - Latest release: 4 months ago - 2 dependent packages - 8 dependent repositories - 13.3 thousand downloads last month - 8,657 stars on GitHub - 1 maintainer
Top 3.9% on pypi.org
openllm-client 0.4.44
OpenLLM Client: Interacting with OpenLLM HTTP/gRPC server, or any BentoML server.
82 versions - Latest release: 4 months ago - 2 dependent packages - 8 dependent repositories - 12.6 thousand downloads last month - 8,657 stars on GitHub - 1 maintainer
open-gpt-torch 0.0.13
An open-source cloud-native of large multi-modal models (LMMs) serving framework.
27 versions - Latest release: 11 months ago - 128 downloads last month - 137 stars on GitHub - 1 maintainer
rungpt 0.1.1
An open-source cloud-native of large multi-modal models (LMMs) serving framework.
2 versions - Latest release: 9 months ago - 34 downloads last month - 137 stars on GitHub - 1 maintainer
clip-api-service 0.1.3
Build AI applications with any CLIP models - embed image and sentences, object recognition, visua...
3 versions - Latest release: 8 months ago - 50 downloads last month - 36 stars on GitHub - 2 maintainers
bentoml-core 0.1.0
The rust core of BentoML: The Unified Model Serving Framework
2 versions - Latest release: about 1 year ago - 35 downloads last month - 6,591 stars on GitHub - 2 maintainers
yatai 0.0.1
Model and deployment management for BentoML
1 version - Latest release: almost 3 years ago - 1 dependent repositories - 32 downloads last month - 6,591 stars on GitHub - 1 maintainer
edge-tpu-silva 1.0.5
Streamlining the process for seamless execution of PyCoral in running TensorFlow Lite models on a...
4 versions - Latest release: 3 months ago - 319 downloads last month - 2 stars on GitHub - 1 maintainer
sentencebertservice 20211205152102
BentoML generated model module
1 version - Latest release: over 2 years ago - 1 dependent repositories - 26 downloads last month - 6,591 stars on GitHub - 1 maintainer