Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org "model-serving" keyword
vllm-online 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs2 versions - Latest release: 22 days ago - 265 downloads last month - 17,633 stars on GitHub - 1 maintainer
Top 3.4% on pypi.org
26 versions - Latest release: 16 days ago - 46 dependent packages - 5 dependent repositories - 435 thousand downloads last month - 17,633 stars on GitHub - 2 maintainers
vllm 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs26 versions - Latest release: 16 days ago - 46 dependent packages - 5 dependent repositories - 435 thousand downloads last month - 17,633 stars on GitHub - 2 maintainers
hive-vllm 0.0.1
a1 version - Latest release: 3 months ago - 7 downloads last month - 17,633 stars on GitHub - 1 maintainer
nextai-vllm 0.0.7
A high-throughput and memory-efficient inference and serving engine for LLMs6 versions - Latest release: 26 days ago - 120 downloads last month - 17,633 stars on GitHub - 1 maintainer
tilearn-test01 0.1
A high-throughput and memory-efficient inference and serving engine for LLMs1 version - Latest release: about 1 month ago - 10 downloads last month - 17,633 stars on GitHub - 1 maintainer
llm-swarm 0.1.1
A high-throughput and memory-efficient inference and serving engine for LLMs2 versions - Latest release: 2 months ago - 75 downloads last month - 17,633 stars on GitHub - 1 maintainer
superlaser 0.0.6
An MLOps library for LLM deployment w/ the vLLM engine on RunPod's infra.6 versions - Latest release: 3 months ago - 64 downloads last month - 17,633 stars on GitHub - 1 maintainer
llm_atc 0.1.7
Tools for fine tuning and serving LLMs6 versions - Latest release: 6 months ago - 50 downloads last month - 17,633 stars on GitHub - 1 maintainer
vllm-xft 0.3.3.1
A high-throughput and memory-efficient inference and serving engine for LLMs2 versions - Latest release: 11 days ago - 107 downloads last month - 17,633 stars on GitHub - 1 maintainer
tilearn-infer 0.3.3
A high-throughput and memory-efficient inference and serving engine for LLMs3 versions - Latest release: 29 days ago - 107 downloads last month - 17,633 stars on GitHub - 1 maintainer
vllm-acc 0.4.1
A high-throughput and memory-efficient inference and serving engine for LLMs7 versions - Latest release: 17 days ago - 1.19 thousand downloads last month - 17,633 stars on GitHub - 1 maintainer
vllm-consul 0.2.1
A high-throughput and memory-efficient inference and serving engine for LLMs5 versions - Latest release: 7 months ago - 43 downloads last month - 12,665 stars on GitHub - 1 maintainer
sentencebertservice 20211205152102
BentoML generated model module1 version - Latest release: over 2 years ago - 1 dependent repositories - 26 downloads last month - 6,591 stars on GitHub - 1 maintainer
bentoml-core 0.1.0
The rust core of BentoML: The Unified Model Serving Framework2 versions - Latest release: 12 months ago - 35 downloads last month - 6,591 stars on GitHub - 2 maintainers
Top 1.2% on pypi.org
147 versions - Latest release: 4 days ago - 13 dependent packages - 499 dependent repositories - 90.5 thousand downloads last month - 6,591 stars on GitHub - 3 maintainers
bentoml 1.2.16
BentoML: Build Production-Grade AI Applications147 versions - Latest release: 4 days ago - 13 dependent packages - 499 dependent repositories - 90.5 thousand downloads last month - 6,591 stars on GitHub - 3 maintainers
yatai 0.0.1
Model and deployment management for BentoML1 version - Latest release: almost 3 years ago - 1 dependent repositories - 32 downloads last month - 6,591 stars on GitHub - 1 maintainer
fedml-afaf 0.7.327 💰
A research and production integrated edge-cloud library for federated/distributed machine learnin...1 version - Latest release: over 1 year ago - 28 downloads last month - 3,931 stars on GitHub - 1 maintainer
Top 3.2% on pypi.org
350 versions - Latest release: 20 days ago - 1 dependent package - 9 dependent repositories - 31.1 thousand downloads last month - 3,930 stars on GitHub - 2 maintainers
fedml 0.8.30 💰
A research and production integrated edge-cloud library for federated/distributed machine learnin...350 versions - Latest release: 20 days ago - 1 dependent package - 9 dependent repositories - 31.1 thousand downloads last month - 3,930 stars on GitHub - 2 maintainers
Top 3.3% on pypi.org
20 versions - Latest release: over 2 years ago - 182 dependent repositories - 4.04 thousand downloads last month - 3,025 stars on GitHub - 4 maintainers
kfserving 0.6.1
KFServing Python SDK20 versions - Latest release: over 2 years ago - 182 dependent repositories - 4.04 thousand downloads last month - 3,025 stars on GitHub - 4 maintainers
Top 1.4% on pypi.org
25 versions - Latest release: 29 days ago - 10 dependent packages - 178 dependent repositories - 51.2 thousand downloads last month - 3,025 stars on GitHub - 1 maintainer
kserve 0.12.1
KServe Python SDK25 versions - Latest release: 29 days ago - 10 dependent packages - 178 dependent repositories - 51.2 thousand downloads last month - 3,025 stars on GitHub - 1 maintainer
kserve-mathking 0.10.0rc3
KServe Python SDK3 versions - Latest release: over 1 year ago - 38 downloads last month - 2,673 stars on GitHub - 1 maintainer
Top 4.4% on pypi.org
106 versions - Latest release: 4 months ago - 3 dependent packages - 5 dependent repositories - 42.7 thousand downloads last month - 1,909 stars on GitHub - 3 maintainers
envd 0.3.45
A development environment management tool for data scientists.106 versions - Latest release: 4 months ago - 3 dependent packages - 5 dependent repositories - 42.7 thousand downloads last month - 1,909 stars on GitHub - 3 maintainers
mlrun-pipelines-kfp-v1-8-experiment 0.2.2
MLRun Pipelines package for providing KFP 1.8 compatibility6 versions - Latest release: 5 days ago - 5.32 thousand downloads last month - 1,318 stars on GitHub - 2 maintainers
mlrun-pipelines-kfp-common-experiment 0.2.0
MLRun Pipelines package for providing KFP 1.8 compatibility5 versions - Latest release: 7 days ago - 5.88 thousand downloads last month - 1,318 stars on GitHub - 1 maintainer
mlrun-pipelines-kfp-v2-experiment 0.2.0
MLRun Pipelines package for providing KFP 2.* compatibility4 versions - Latest release: 7 days ago - 1.05 thousand downloads last month - 1,318 stars on GitHub - 1 maintainer
Top 4.1% on pypi.org
543 versions - Latest release: about 2 months ago - 1 dependent package - 9 dependent repositories - 21.2 thousand downloads last month - 1,318 stars on GitHub - 2 maintainers
mlrun 1.6.2
Tracking and config of machine learning runs543 versions - Latest release: about 2 months ago - 1 dependent package - 9 dependent repositories - 21.2 thousand downloads last month - 1,318 stars on GitHub - 2 maintainers
Top 3.6% on pypi.org
214 versions - Latest release: 12 days ago - 2 dependent packages - 5 dependent repositories - 31.8 thousand downloads last month - 843 stars on GitHub - 6 maintainers
truss 0.9.11
A seamless bridge from model development to model delivery214 versions - Latest release: 12 days ago - 2 dependent packages - 5 dependent repositories - 31.8 thousand downloads last month - 843 stars on GitHub - 6 maintainers
mosec-tiinfer 0.0.7
Model Serving made Efficient in the Cloud.1 version - Latest release: about 1 year ago - 33 downloads last month - 712 stars on GitHub - 1 maintainer
Top 7.4% on pypi.org
41 versions - Latest release: 3 months ago - 1 dependent package - 1 dependent repositories - 1.71 thousand downloads last month - 657 stars on GitHub - 2 maintainers
mosec 0.8.4
Model Serving made Efficient in the Cloud41 versions - Latest release: 3 months ago - 1 dependent package - 1 dependent repositories - 1.71 thousand downloads last month - 657 stars on GitHub - 2 maintainers
Top 2.8% on pypi.org
6 versions - Latest release: 8 months ago - 5 dependent packages - 24 dependent repositories - 17.2 thousand downloads last month - 635 stars on GitHub - 1 maintainer
ovmsclient 2023.1
Python client for OpenVINO Model Server6 versions - Latest release: 8 months ago - 5 dependent packages - 24 dependent repositories - 17.2 thousand downloads last month - 635 stars on GitHub - 1 maintainer
pinferencia 0.2.1
Aims to be the Simplest Machine Learning Model Inference Server15 versions - Latest release: over 1 year ago - 1 dependent repositories - 110 downloads last month - 557 stars on GitHub - 1 maintainer
pinference 0.1.0b1
Aims to be the Simplest Machine Learning Model Inference Server1 version - Latest release: about 2 years ago - 1 dependent repositories - 13 downloads last month - 557 stars on GitHub - 1 maintainer
lorax-client 0.5.1
LoRAX Python Client9 versions - Latest release: 4 days ago - 2.06 thousand downloads last month - 516 stars on GitHub - 1 maintainer
onediffusion 0.0.3
Onediffusion: REST API server for running any diffusion models - Stable Diffusion, Anything, Cont...3 versions - Latest release: 9 months ago - 57 downloads last month - 317 stars on GitHub - 2 maintainers
Top 7.9% on pypi.org
38 versions - Latest release: over 2 years ago - 1 dependent package - 3 dependent repositories - 2.51 thousand downloads last month - 224 stars on GitHub - 1 maintainer
chitra 0.2.0 💰
A multi functional library for full stack Deep Learning.38 versions - Latest release: over 2 years ago - 1 dependent package - 3 dependent repositories - 2.51 thousand downloads last month - 224 stars on GitHub - 1 maintainer
open-gpt-torch 0.0.13
An open-source cloud-native of large multi-modal models (LMMs) serving framework.27 versions - Latest release: 10 months ago - 127 downloads last month - 134 stars on GitHub - 1 maintainer
rungpt 0.1.1
An open-source cloud-native of large multi-modal models (LMMs) serving framework.2 versions - Latest release: 9 months ago - 43 downloads last month - 134 stars on GitHub - 1 maintainer
google-jetstream 0.2.1
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting ...4 versions - Latest release: 17 days ago - 11.6 thousand downloads last month - 126 stars on GitHub - 1 maintainer
Top 7.7% on pypi.org
9 versions - Latest release: about 1 year ago - 3 dependent repositories - 1.9 thousand downloads last month - 124 stars on GitHub - 1 maintainer
clearml-serving 1.3.0
clearml-serving - Model-Serving Orchestration and Repository Solution9 versions - Latest release: about 1 year ago - 3 dependent repositories - 1.9 thousand downloads last month - 124 stars on GitHub - 1 maintainer
fastdeploy 3.0.13
Deploy DL/ ML inference pipelines with minimal extra code.69 versions - Latest release: 28 days ago - 1 dependent repositories - 650 downloads last month - 90 stars on GitHub - 1 maintainer
fdclient 3.0.5
fastDeploy python client7 versions - Latest release: 2 months ago - 58 downloads last month - 90 stars on GitHub - 1 maintainer
nimblebox 0.9.16
ML Inference 🥶2 versions - Latest release: almost 2 years ago - 1 dependent repositories - 13 downloads last month - 89 stars on GitHub - 1 maintainer
Top 8.9% on pypi.org
317 versions - Latest release: about 1 year ago - 2 dependent repositories - 1.47 thousand downloads last month - 88 stars on GitHub - 1 maintainer
nbox 0.12.4
ML Inference 🥶317 versions - Latest release: about 1 year ago - 2 dependent repositories - 1.47 thousand downloads last month - 88 stars on GitHub - 1 maintainer
dainik 0.0.0
Client library for working with NimbleBox LMAO17 versions - Latest release: almost 2 years ago - 64 downloads last month - 88 stars on GitHub - 1 maintainer
lmao 1.18
Client library for working with NimbleBox LMAO1 version - Latest release: almost 2 years ago - 8 downloads last month - 88 stars on GitHub - 1 maintainer
Top 7.7% on pypi.org
16 versions - Latest release: 26 days ago - 6 dependent repositories - 883 downloads last month - 83 stars on GitHub - 3 maintainers
monai-deploy-app-sdk 2.0.0
A framework and associated tools to design, verify and analyze performance of MONAI apps16 versions - Latest release: 26 days ago - 6 dependent repositories - 883 downloads last month - 83 stars on GitHub - 3 maintainers
monai-app-sdk 0.0.0
A framework and associated tools to design, verify and analyze performance of MONAI apps1 version - Latest release: almost 3 years ago - 1 dependent repositories - 13 downloads last month - 80 stars on GitHub - 1 maintainer
fasttext-serving 0.2.0 💰
fasttext-serving gRPC client3 versions - Latest release: over 3 years ago - 1 dependent repositories - 33 downloads last month - 58 stars on GitHub - 1 maintainer
fasttext-serving-server 0.6.2 💰
fastText model serving API server1 version - Latest release: about 3 years ago - 1 dependent repositories - 22 downloads last month - 58 stars on GitHub - 1 maintainer
clip-api-service 0.1.3
Build AI applications with any CLIP models - embed image and sentences, object recognition, visua...3 versions - Latest release: 7 months ago - 50 downloads last month - 36 stars on GitHub - 2 maintainers
mlserve 0.0.1a6
mlserve -- turns python model into RESTful API with automatically generated UI.6 versions - Latest release: almost 6 years ago - 1 dependent repositories - 26 downloads last month - 26 stars on GitHub - 1 maintainer
titus2 1.2.1
Python 3 implementation of Portable Format for Analytics (PFA): producer, converter, and consumer.5 versions - Latest release: over 1 year ago - 2 dependent repositories - 45 downloads last month - 23 stars on GitHub - 1 maintainer
modzy-sdk 0.11.6
Modzy's Python SDK queries and deploys models, submits inference jobs and returns results directl...28 versions - Latest release: 9 months ago - 2 dependent repositories - 197 downloads last month - 23 stars on GitHub - 2 maintainers
surround 0.1.2
Surround is a framework for serving machine learning pipelines in Python.17 versions - Latest release: over 2 years ago - 6 dependent repositories - 181 downloads last month - 22 stars on GitHub - 1 maintainer
surround-cli 0.0.5
Command line interface for Surround5 versions - Latest release: over 2 years ago - 1 dependent repositories - 56 downloads last month - 22 stars on GitHub - 1 maintainer
kedro-serving 0.0.1
A kedro plugin to serve kedro pipelines1 version - Latest release: over 2 years ago - 1 dependent repositories - 9 downloads last month - 13 stars on GitHub - 1 maintainer
tftree 0.1.8 💰
Tree to tensorflow8 versions - Latest release: over 4 years ago - 1 dependent repositories - 56 downloads last month - 9 stars on GitHub - 1 maintainer
ventu 0.4.5 💰
Host your deep learning models easily.9 versions - Latest release: almost 4 years ago - 1 dependent repositories - 66 downloads last month - 9 stars on GitHub - 1 maintainer
hsmlfix 2.5.1
HSML: An environment independent client to interact with the Hopsworks Model Registry3 versions - Latest release: over 2 years ago - 1 dependent repositories - 22 downloads last month - 8 stars on GitHub - 1 maintainer
hsmltestfix 2.4.1
HSML: An environment independent client to interact with the Hopsworks Model Registry2 versions - Latest release: over 2 years ago - 1 dependent repositories - 27 downloads last month - 8 stars on GitHub - 1 maintainer
hopsml 2.4.1
HSML: An environment independent client to interact with the Hopsworks Model Registry1 version - Latest release: over 2 years ago - 1 dependent repositories - 13 downloads last month - 8 stars on GitHub - 1 maintainer
Top 8.6% on pypi.org
34 versions - Latest release: 21 days ago - 1 dependent package - 5 dependent repositories - 11.2 thousand downloads last month - 8 stars on GitHub - 2 maintainers
hsml 3.7.1
HSML: An environment independent client to interact with the Hopsworks Model Registry34 versions - Latest release: 21 days ago - 1 dependent package - 5 dependent repositories - 11.2 thousand downloads last month - 8 stars on GitHub - 2 maintainers
hsml-test 2.4.1
HSML: An environment independent client to interact with the Hopsworks Model Registry2 versions - Latest release: over 2 years ago - 1 dependent repositories - 16 downloads last month - 8 stars on GitHub - 1 maintainer
tfservingspark 0.1.0
Tensorflow serving on spark dataframe1 version - Latest release: about 6 years ago - 1 dependent repositories - 23 downloads last month - 7 stars on GitHub - 1 maintainer
krypton-ml 0.1.1
Model Server for ML and DL Models built using FastAPI2 versions - Latest release: almost 4 years ago - 1 dependent repositories - 27 downloads last month - 4 stars on GitHub - 1 maintainer
mldrop-client 0.1.1
Python client for MLDrop by Scattering AI2 versions - Latest release: about 1 year ago - 9 downloads last month - 3 stars on GitHub - 1 maintainer
Related Keywords
mlops
40
machine-learning
33
pytorch
29
deep-learning
20
inference
19
llmops
19
python
19
model-deployment
19
llm
17
llama
16
llm-serving
16
gpt
14
kubernetes
13
transformer
13
data-science
12
ai
11
trainium
11
rocm
11
inferentia
11
cuda
11
amd
11
tensorflow
10
MLOps
10
mlops-workflow
9
Machine Learning
9
serving
9
ml-platform
9
hacktoberfest
7
artificial-intelligence
7
model-management
7
workflow
6
transformers
6
PyTorch
6
ml-infrastructure
6
model-inference
6
inference-api
5
inference-server
5
Hopsworks
5
ML
5
Models
5
Machine Learning Models
5
Model Registry
5
TensorFlow
5
DataOps
5
Model Serving
5
model-registry
5
experiment-tracking
4
data-engineering
4
docker
4
xgboost
4
sklearn
4
nlp
4
generative-ai
4
mlrun
4
microservices
4
AI
4
ml-service
4
mlops-automation
4
BentoML
4
Model Deployment
4
practical-mlops
4
model-monitoring
4
mlops-pipeline
4
mlops-tool
4
kfp
3
falcon
3
gpu
3
jax
3
machine learning
3
deployment
3
LLM
3
fastapi
3
image-processing
3
cloud-native
3
large-language-models
3
tensorflow-serving
3
triton
3
triton-inference-server
3
inference-engine
3
kubeflow
3
kubeflow-pipelines
3
lmops
3
mlops-community
3
kserve
3
hacktoberfest2023
3
model-interpretability
3
service-mesh
3
llm-inference
3
knative
3
ai-infra
3
multimodal-deep-learning
3
bentoml
3
istio
3
k8s
3
on-device-training
2
jina
2
large-language-model
2
learning
2
machine
2
self-hosting
2