Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org "model-inference" keyword
Top 3.9% on pypi.org
74 versions - Latest release: 4 months ago - 2 dependent packages - 8 dependent repositories - 13.7 thousand downloads last month - 8,657 stars on GitHub - 1 maintainer
openllm-client 0.4.44
OpenLLM Client: Interacting with OpenLLM HTTP/gRPC server, or any BentoML server.74 versions - Latest release: 4 months ago - 2 dependent packages - 8 dependent repositories - 13.7 thousand downloads last month - 8,657 stars on GitHub - 1 maintainer
Top 2.2% on pypi.org
153 versions - Latest release: 4 months ago - 3 dependent packages - 295 dependent repositories - 16.8 thousand downloads last month - 8,657 stars on GitHub - 2 maintainers
openllm 0.4.44
OpenLLM: Operating LLMs in production153 versions - Latest release: 4 months ago - 3 dependent packages - 295 dependent repositories - 16.8 thousand downloads last month - 8,657 stars on GitHub - 2 maintainers
Top 3.5% on pypi.org
74 versions - Latest release: 4 months ago - 2 dependent packages - 8 dependent repositories - 13.9 thousand downloads last month - 8,657 stars on GitHub - 1 maintainer
openllm-core 0.4.44
OpenLLM Core: Core components for OpenLLM.74 versions - Latest release: 4 months ago - 2 dependent packages - 8 dependent repositories - 13.9 thousand downloads last month - 8,657 stars on GitHub - 1 maintainer
rungpt 0.1.1
An open-source cloud-native of large multi-modal models (LMMs) serving framework.2 versions - Latest release: 9 months ago - 43 downloads last month - 134 stars on GitHub - 1 maintainer
clip-api-service 0.1.3
Build AI applications with any CLIP models - embed image and sentences, object recognition, visua...3 versions - Latest release: 7 months ago - 50 downloads last month - 36 stars on GitHub - 2 maintainers
bentoml-core 0.1.0
The rust core of BentoML: The Unified Model Serving Framework2 versions - Latest release: 12 months ago - 35 downloads last month - 6,591 stars on GitHub - 2 maintainers
open-gpt-torch 0.0.13
An open-source cloud-native of large multi-modal models (LMMs) serving framework.27 versions - Latest release: 10 months ago - 127 downloads last month - 134 stars on GitHub - 1 maintainer
yatai 0.0.1
Model and deployment management for BentoML1 version - Latest release: almost 3 years ago - 1 dependent repositories - 32 downloads last month - 6,591 stars on GitHub - 1 maintainer
edge-tpu-silva 1.0.5
Streamlining the process for seamless execution of PyCoral in running TensorFlow Lite models on a...4 versions - Latest release: 2 months ago - 319 downloads last month - 2 stars on GitHub - 1 maintainer
sentencebertservice 20211205152102
BentoML generated model module1 version - Latest release: over 2 years ago - 1 dependent repositories - 26 downloads last month - 6,591 stars on GitHub - 1 maintainer
Related Keywords
mlops
7
llmops
6
model-serving
6
bentoml
6
ai
6
BentoML
5
vicuna
5
llama
5
machine-learning
5
Model Serving
4
AI
4
Model Deployment
4
MLOps
4
mpt
3
multimodal-deep-learning
3
open-source-llm
3
openllm
3
stablelm
3
model-management
3
cloud-native
3
model-deployment
3
ml-platform
3
transformers
3
microservices
3
lmops
3
kubernetes
3
ai-infra
3
deep-learning
3
generative-ai
3
inference-api
3
Llama 2
3
PyTorch
3
Serverless
3
StableLM
3
Transformers
3
Large Language Model
3
LLMOps
3
Generative AI
3
Fine tuning
3
Vicuna
3
Falcon
3
Alpaca
3
falcon
3
fine-tuning
3
ml
3
mistral
3
llm-serving
3
llm-ops
3
llm-inference
3
llm
3
llama2
3
stabellm
2
flamingo
2
gpt-4
2
large-language-models
2
large-multimadality-models
2
jina
2
pytorch
2
large-language-model
2
GPT
2
object-detection
2
LLM
2
self-hosting
2
opengpt
2
multi-modality
2
lmm-serve
2
llm-serve
2
llm-hosting
2
coral-tpu
1
edge-computing
1
fps
1
pycoral
1
raspberry-pi
1
raspberry-pi-4
1
openai-clip
1
model-inference-service
1
clip
1
ai-applications
1
artificial-intelligence
1
image-classification
1
visual-reasoning
1
image-search
1
Model-Inference
1
CLIP
1
vLLM
1
Mistral
1