Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org "model-serving" keyword
Top 3.2% on pypi.org
350 versions - Latest release: 10 days ago - 1 dependent package - 9 dependent repositories - 31.5 thousand downloads last month - 3,930 stars on GitHub - 2 maintainers
fedml 0.8.30 💰
A research and production integrated edge-cloud library for federated/distributed machine learnin...350 versions - Latest release: 10 days ago - 1 dependent package - 9 dependent repositories - 31.5 thousand downloads last month - 3,930 stars on GitHub - 2 maintainers
fedml-afaf 0.7.327 💰
A research and production integrated edge-cloud library for federated/distributed machine learnin...1 version - Latest release: over 1 year ago - 27 downloads last month - 3,931 stars on GitHub - 1 maintainer
vllm-xft 0.3.3.0
A high-throughput and memory-efficient inference and serving engine for LLMs1 version - Latest release: about 1 month ago - 25 downloads last month - 17,633 stars on GitHub - 2 maintainers
llm-swarm 0.1.1
A high-throughput and memory-efficient inference and serving engine for LLMs2 versions - Latest release: 2 months ago - 79 downloads last month - 17,633 stars on GitHub - 2 maintainers
vllm-acc 0.4.1
A high-throughput and memory-efficient inference and serving engine for LLMs7 versions - Latest release: 6 days ago - 1.15 thousand downloads last month - 17,633 stars on GitHub - 2 maintainers
Top 3.4% on pypi.org
26 versions - Latest release: 5 days ago - 7 dependent packages - 5 dependent repositories - 509 thousand downloads last month - 17,633 stars on GitHub - 4 maintainers
vllm 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs26 versions - Latest release: 5 days ago - 7 dependent packages - 5 dependent repositories - 509 thousand downloads last month - 17,633 stars on GitHub - 4 maintainers
nextai-vllm 0.0.7
A high-throughput and memory-efficient inference and serving engine for LLMs6 versions - Latest release: 15 days ago - 149 downloads last month - 17,633 stars on GitHub - 2 maintainers
vllm-online 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs2 versions - Latest release: 11 days ago - 262 downloads last month - 17,633 stars on GitHub - 2 maintainers
tilearn-test01 0.1
A high-throughput and memory-efficient inference and serving engine for LLMs1 version - Latest release: about 1 month ago - 25 downloads last month - 17,633 stars on GitHub - 2 maintainers
vllm-consul 0.2.1
A high-throughput and memory-efficient inference and serving engine for LLMs5 versions - Latest release: 7 months ago - 39 downloads last month - 12,665 stars on GitHub - 2 maintainers
superlaser 0.0.6
An MLOps library for LLM deployment w/ the vLLM engine on RunPod's infra.6 versions - Latest release: 2 months ago - 80 downloads last month - 17,633 stars on GitHub - 2 maintainers
hive-vllm 0.0.1
a1 version - Latest release: 2 months ago - 7 downloads last month - 17,633 stars on GitHub - 1 maintainer
tilearn-infer 0.3.3
A high-throughput and memory-efficient inference and serving engine for LLMs3 versions - Latest release: 18 days ago - 255 downloads last month - 17,633 stars on GitHub - 2 maintainers
llm_atc 0.1.7
Tools for fine tuning and serving LLMs6 versions - Latest release: 5 months ago - 39 downloads last month - 17,633 stars on GitHub - 2 maintainers
Top 1.2% on pypi.org
146 versions - Latest release: about 11 hours ago - 10 dependent packages - 499 dependent repositories - 85.7 thousand downloads last month - 6,561 stars on GitHub - 4 maintainers
bentoml 1.2.15
BentoML: Build Production-Grade AI Applications146 versions - Latest release: about 11 hours ago - 10 dependent packages - 499 dependent repositories - 85.7 thousand downloads last month - 6,561 stars on GitHub - 4 maintainers
mlrun-pipelines-kfp-common-experiment 0.1.3
MLRun Pipelines package for providing KFP 1.8 compatibility4 versions - Latest release: 27 days ago - 1.06 thousand downloads last month - 1,309 stars on GitHub - 2 maintainers
mlrun-pipelines-kfp-v1-8-experiment 0.1.3
MLRun Pipelines package for providing KFP 1.8 compatibility3 versions - Latest release: 27 days ago - 933 downloads last month - 1,309 stars on GitHub - 4 maintainers
mlrun-pipelines-kfp-v2-experiment 0.1.2
MLRun Pipelines package for providing KFP 2.* compatibility3 versions - Latest release: 20 days ago - 366 downloads last month - 1,309 stars on GitHub - 2 maintainers
Top 4.4% on pypi.org
106 versions - Latest release: 4 months ago - 3 dependent packages - 5 dependent repositories - 37.5 thousand downloads last month - 1,909 stars on GitHub - 3 maintainers
envd 0.3.45
A development environment management tool for data scientists.106 versions - Latest release: 4 months ago - 3 dependent packages - 5 dependent repositories - 37.5 thousand downloads last month - 1,909 stars on GitHub - 3 maintainers
Top 3.6% on pypi.org
211 versions - Latest release: 1 day ago - 2 dependent packages - 5 dependent repositories - 37 thousand downloads last month - 839 stars on GitHub - 6 maintainers
truss 0.9.11
A seamless bridge from model development to model delivery211 versions - Latest release: 1 day ago - 2 dependent packages - 5 dependent repositories - 37 thousand downloads last month - 839 stars on GitHub - 6 maintainers
Top 1.4% on pypi.org
25 versions - Latest release: 19 days ago - 9 dependent packages - 178 dependent repositories - 46.5 thousand downloads last month - 3,025 stars on GitHub - 1 maintainer
kserve 0.12.1
KServe Python SDK25 versions - Latest release: 19 days ago - 9 dependent packages - 178 dependent repositories - 46.5 thousand downloads last month - 3,025 stars on GitHub - 1 maintainer
hopsml 2.4.1
HSML: An environment independent client to interact with the Hopsworks Model Registry1 version - Latest release: over 2 years ago - 1 dependent repositories - 8 downloads last month - 8 stars on GitHub - 1 maintainer
hsmltestfix 2.4.1
HSML: An environment independent client to interact with the Hopsworks Model Registry2 versions - Latest release: over 2 years ago - 1 dependent repositories - 25 downloads last month - 8 stars on GitHub - 1 maintainer
hsmlfix 2.5.1
HSML: An environment independent client to interact with the Hopsworks Model Registry3 versions - Latest release: over 2 years ago - 1 dependent repositories - 15 downloads last month - 8 stars on GitHub - 2 maintainers
Top 8.6% on pypi.org
34 versions - Latest release: 11 days ago - 1 dependent package - 5 dependent repositories - 9.87 thousand downloads last month - 8 stars on GitHub - 2 maintainers
hsml 3.7.1
HSML: An environment independent client to interact with the Hopsworks Model Registry34 versions - Latest release: 11 days ago - 1 dependent package - 5 dependent repositories - 9.87 thousand downloads last month - 8 stars on GitHub - 2 maintainers
hsml-test 2.4.1
HSML: An environment independent client to interact with the Hopsworks Model Registry2 versions - Latest release: over 2 years ago - 1 dependent repositories - 13 downloads last month - 8 stars on GitHub - 1 maintainer
Top 4.1% on pypi.org
537 versions - Latest release: about 1 month ago - 9 dependent repositories - 21.9 thousand downloads last month - 1,306 stars on GitHub - 3 maintainers
mlrun 1.6.2
Tracking and config of machine learning runs537 versions - Latest release: about 1 month ago - 9 dependent repositories - 21.9 thousand downloads last month - 1,306 stars on GitHub - 3 maintainers
google-jetstream 0.2.1
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting ...4 versions - Latest release: 6 days ago - 11.6 thousand downloads last month - 126 stars on GitHub - 2 maintainers
tfservingspark 0.1.0
Tensorflow serving on spark dataframe1 version - Latest release: about 6 years ago - 1 dependent repositories - 23 downloads last month - 7 stars on GitHub - 1 maintainer
mlserve 0.0.1a6
mlserve -- turns python model into RESTful API with automatically generated UI.6 versions - Latest release: over 5 years ago - 1 dependent repositories - 26 downloads last month - 26 stars on GitHub - 2 maintainers
sentencebertservice 20211205152102
BentoML generated model module1 version - Latest release: over 2 years ago - 1 dependent repositories - 17 downloads last month - 6,558 stars on GitHub - 1 maintainer
bentoml-core 0.1.0
The rust core of BentoML: The Unified Model Serving Framework2 versions - Latest release: 12 months ago - 34 downloads last month - 6,558 stars on GitHub - 4 maintainers
yatai 0.0.1
Model and deployment management for BentoML1 version - Latest release: almost 3 years ago - 1 dependent repositories - 33 downloads last month - 6,558 stars on GitHub - 2 maintainers
Top 7.9% on pypi.org
38 versions - Latest release: over 2 years ago - 1 dependent package - 3 dependent repositories - 2.51 thousand downloads last month - 224 stars on GitHub - 2 maintainers
chitra 0.2.0 💰
A multi functional library for full stack Deep Learning.38 versions - Latest release: over 2 years ago - 1 dependent package - 3 dependent repositories - 2.51 thousand downloads last month - 224 stars on GitHub - 2 maintainers
fasttext-serving 0.2.0 💰
fasttext-serving gRPC client3 versions - Latest release: over 3 years ago - 1 dependent repositories - 33 downloads last month - 58 stars on GitHub - 1 maintainer
fasttext-serving-server 0.6.2 💰
fastText model serving API server1 version - Latest release: about 3 years ago - 1 dependent repositories - 22 downloads last month - 58 stars on GitHub - 2 maintainers
lorax-client 0.5.0
LoRAX Python Client8 versions - Latest release: 16 days ago - 2.06 thousand downloads last month - 516 stars on GitHub - 2 maintainers
titus2 1.2.1
Python 3 implementation of Portable Format for Analytics (PFA): producer, converter, and consumer.5 versions - Latest release: about 1 year ago - 2 dependent repositories - 45 downloads last month - 23 stars on GitHub - 2 maintainers
ventu 0.4.5 💰
Host your deep learning models easily.9 versions - Latest release: almost 4 years ago - 1 dependent repositories - 66 downloads last month - 9 stars on GitHub - 2 maintainers
pinference 0.1.0b1
Aims to be the Simplest Machine Learning Model Inference Server1 version - Latest release: about 2 years ago - 1 dependent repositories - 13 downloads last month - 557 stars on GitHub - 1 maintainer
pinferencia 0.2.1
Aims to be the Simplest Machine Learning Model Inference Server15 versions - Latest release: over 1 year ago - 1 dependent repositories - 110 downloads last month - 557 stars on GitHub - 1 maintainer
mosec-tiinfer 0.0.7
Model Serving made Efficient in the Cloud.1 version - Latest release: about 1 year ago - 41 downloads last month - 705 stars on GitHub - 2 maintainers
Top 7.4% on pypi.org
41 versions - Latest release: 2 months ago - 1 dependent package - 1 dependent repositories - 2.62 thousand downloads last month - 657 stars on GitHub - 2 maintainers
mosec 0.8.4
Model Serving made Efficient in the Cloud41 versions - Latest release: 2 months ago - 1 dependent package - 1 dependent repositories - 2.62 thousand downloads last month - 657 stars on GitHub - 2 maintainers
Top 3.3% on pypi.org
20 versions - Latest release: over 2 years ago - 182 dependent repositories - 5.56 thousand downloads last month - 2,887 stars on GitHub - 4 maintainers
kfserving 0.6.1
KFServing Python SDK20 versions - Latest release: over 2 years ago - 182 dependent repositories - 5.56 thousand downloads last month - 2,887 stars on GitHub - 4 maintainers
rungpt 0.1.1
An open-source cloud-native of large multi-modal models (LMMs) serving framework.2 versions - Latest release: 8 months ago - 43 downloads last month - 134 stars on GitHub - 2 maintainers
open-gpt-torch 0.0.13
An open-source cloud-native of large multi-modal models (LMMs) serving framework.27 versions - Latest release: 10 months ago - 127 downloads last month - 134 stars on GitHub - 2 maintainers
mldrop-client 0.1.1
Python client for MLDrop by Scattering AI2 versions - Latest release: about 1 year ago - 9 downloads last month - 3 stars on GitHub - 2 maintainers
Top 7.7% on pypi.org
16 versions - Latest release: 15 days ago - 6 dependent repositories - 900 downloads last month - 80 stars on GitHub - 6 maintainers
monai-deploy-app-sdk 2.0.0
A framework and associated tools to design, verify and analyze performance of MONAI apps16 versions - Latest release: 15 days ago - 6 dependent repositories - 900 downloads last month - 80 stars on GitHub - 6 maintainers
Top 2.8% on pypi.org
6 versions - Latest release: 8 months ago - 5 dependent packages - 24 dependent repositories - 17.2 thousand downloads last month - 635 stars on GitHub - 1 maintainer
ovmsclient 2023.1
Python client for OpenVINO Model Server6 versions - Latest release: 8 months ago - 5 dependent packages - 24 dependent repositories - 17.2 thousand downloads last month - 635 stars on GitHub - 1 maintainer
fdclient 3.0.5
fastDeploy python client7 versions - Latest release: about 2 months ago - 58 downloads last month - 90 stars on GitHub - 2 maintainers
fastdeploy 3.0.13
Deploy DL/ ML inference pipelines with minimal extra code.69 versions - Latest release: 18 days ago - 1 dependent repositories - 650 downloads last month - 90 stars on GitHub - 2 maintainers
lmao 1.18
Client library for working with NimbleBox LMAO1 version - Latest release: over 1 year ago - 8 downloads last month - 88 stars on GitHub - 2 maintainers
nimblebox 0.9.16
ML Inference 🥶2 versions - Latest release: almost 2 years ago - 1 dependent repositories - 13 downloads last month - 89 stars on GitHub - 2 maintainers
dainik 0.0.0
Client library for working with NimbleBox LMAO17 versions - Latest release: almost 2 years ago - 64 downloads last month - 88 stars on GitHub - 2 maintainers
tftree 0.1.8 💰
Tree to tensorflow8 versions - Latest release: about 4 years ago - 1 dependent repositories - 56 downloads last month - 9 stars on GitHub - 2 maintainers
Top 8.9% on pypi.org
317 versions - Latest release: about 1 year ago - 2 dependent repositories - 1.47 thousand downloads last month - 88 stars on GitHub - 1 maintainer
nbox 0.12.4
ML Inference 🥶317 versions - Latest release: about 1 year ago - 2 dependent repositories - 1.47 thousand downloads last month - 88 stars on GitHub - 1 maintainer
kedro-serving 0.0.1
A kedro plugin to serve kedro pipelines1 version - Latest release: over 2 years ago - 1 dependent repositories - 9 downloads last month - 13 stars on GitHub - 1 maintainer
monai-app-sdk 0.0.0
A framework and associated tools to design, verify and analyze performance of MONAI apps1 version - Latest release: almost 3 years ago - 1 dependent repositories - 13 downloads last month - 80 stars on GitHub - 1 maintainer
krypton-ml 0.1.1
Model Server for ML and DL Models built using FastAPI2 versions - Latest release: almost 4 years ago - 1 dependent repositories - 9 downloads last month - 4 stars on GitHub - 2 maintainers
onediffusion 0.0.3
Onediffusion: REST API server for running any diffusion models - Stable Diffusion, Anything, Cont...3 versions - Latest release: 8 months ago - 48 downloads last month - 317 stars on GitHub - 3 maintainers
kserve-mathking 0.10.0rc3
KServe Python SDK3 versions - Latest release: over 1 year ago - 13 downloads last month - 2,673 stars on GitHub - 1 maintainer
Top 7.7% on pypi.org
9 versions - Latest release: about 1 year ago - 3 dependent repositories - 1.37 thousand downloads last month - 124 stars on GitHub - 1 maintainer
clearml-serving 1.3.0
clearml-serving - Model-Serving Orchestration and Repository Solution9 versions - Latest release: about 1 year ago - 3 dependent repositories - 1.37 thousand downloads last month - 124 stars on GitHub - 1 maintainer
surround-cli 0.0.5
Command line interface for Surround5 versions - Latest release: over 2 years ago - 1 dependent repositories - 24 downloads last month - 22 stars on GitHub - 2 maintainers
surround 0.1.2
Surround is a framework for serving machine learning pipelines in Python.17 versions - Latest release: over 2 years ago - 6 dependent repositories - 59 downloads last month - 22 stars on GitHub - 2 maintainers
clip-api-service 0.1.3
Build AI applications with any CLIP models - embed image and sentences, object recognition, visua...3 versions - Latest release: 7 months ago - 19 downloads last month - 35 stars on GitHub - 3 maintainers
modzy-sdk 0.11.6
Modzy's Python SDK queries and deploys models, submits inference jobs and returns results directl...28 versions - Latest release: 8 months ago - 2 dependent repositories - 69 downloads last month - 23 stars on GitHub - 2 maintainers
Related Keywords
mlops
40
machine-learning
33
pytorch
29
deep-learning
20
model-deployment
20
llmops
19
inference
19
python
18
llm
16
llama
16
llm-serving
15
kubernetes
14
gpt
14
transformer
13
ai
12
data-science
12
trainium
11
rocm
11
inferentia
11
amd
11
cuda
11
ml-platform
10
MLOps
10
tensorflow
10
Machine Learning
9
mlops-workflow
9
serving
9
model-management
8
hacktoberfest
7
artificial-intelligence
7
model-inference
7
inference-api
6
workflow
6
ml-infrastructure
6
transformers
6
PyTorch
6
Hopsworks
5
inference-server
5
microservices
5
model-registry
5
DataOps
5
TensorFlow
5
Model Serving
5
Model Registry
5
Machine Learning Models
5
ML
5
Models
5
docker
4
sklearn
4
experiment-tracking
4
xgboost
4
nlp
4
data-engineering
4
mlrun
4
multimodal-deep-learning
4
lmops
4
generative-ai
4
bentoml
4
ai-infra
4
Model Deployment
4
BentoML
4
AI
4
practical-mlops
4
ml-service
4
mlops-automation
4
mlops-pipeline
4
model-monitoring
4
mlops-tool
4
image-processing
3
kubeflow-pipelines
3
kserve
3
kubeflow
3
mlops-community
3
model-interpretability
3
service-mesh
3
gpu
3
jax
3
large-language-models
3
inference-engine
3
fastapi
3
triton-inference-server
3
LLM
3
triton
3
deployment
3
tensorflow-serving
3
kfp
3
cloud-native
3
falcon
3
machine learning
3
hacktoberfest2023
3
istio
3
k8s
3
knative
3
GPT
2
large-language-model
2
vicuna
2
stabellm
2
jina
2
tts
2
flamingo
2