Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "model-serving" keyword

Top 3.2% on pypi.org
fedml 0.8.30 💰
A research and production integrated edge-cloud library for federated/distributed machine learnin...
350 versions - Latest release: 10 days ago - 1 dependent package - 9 dependent repositories - 31.5 thousand downloads last month - 3,930 stars on GitHub - 2 maintainers
fedml-afaf 0.7.327 💰
A research and production integrated edge-cloud library for federated/distributed machine learnin...
1 version - Latest release: over 1 year ago - 27 downloads last month - 3,931 stars on GitHub - 1 maintainer
vllm-xft 0.3.3.0
A high-throughput and memory-efficient inference and serving engine for LLMs
1 version - Latest release: about 1 month ago - 25 downloads last month - 17,633 stars on GitHub - 2 maintainers
llm-swarm 0.1.1
A high-throughput and memory-efficient inference and serving engine for LLMs
2 versions - Latest release: 2 months ago - 79 downloads last month - 17,633 stars on GitHub - 2 maintainers
vllm-acc 0.4.1
A high-throughput and memory-efficient inference and serving engine for LLMs
7 versions - Latest release: 6 days ago - 1.15 thousand downloads last month - 17,633 stars on GitHub - 2 maintainers
Top 3.4% on pypi.org
vllm 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs
26 versions - Latest release: 5 days ago - 7 dependent packages - 5 dependent repositories - 509 thousand downloads last month - 17,633 stars on GitHub - 4 maintainers
nextai-vllm 0.0.7
A high-throughput and memory-efficient inference and serving engine for LLMs
6 versions - Latest release: 15 days ago - 149 downloads last month - 17,633 stars on GitHub - 2 maintainers
vllm-online 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs
2 versions - Latest release: 11 days ago - 262 downloads last month - 17,633 stars on GitHub - 2 maintainers
tilearn-test01 0.1
A high-throughput and memory-efficient inference and serving engine for LLMs
1 version - Latest release: about 1 month ago - 25 downloads last month - 17,633 stars on GitHub - 2 maintainers
vllm-consul 0.2.1
A high-throughput and memory-efficient inference and serving engine for LLMs
5 versions - Latest release: 7 months ago - 39 downloads last month - 12,665 stars on GitHub - 2 maintainers
superlaser 0.0.6
An MLOps library for LLM deployment w/ the vLLM engine on RunPod's infra.
6 versions - Latest release: 2 months ago - 80 downloads last month - 17,633 stars on GitHub - 2 maintainers
hive-vllm 0.0.1
a
1 version - Latest release: 2 months ago - 7 downloads last month - 17,633 stars on GitHub - 1 maintainer
tilearn-infer 0.3.3
A high-throughput and memory-efficient inference and serving engine for LLMs
3 versions - Latest release: 18 days ago - 255 downloads last month - 17,633 stars on GitHub - 2 maintainers
llm_atc 0.1.7
Tools for fine tuning and serving LLMs
6 versions - Latest release: 5 months ago - 39 downloads last month - 17,633 stars on GitHub - 2 maintainers
Top 1.2% on pypi.org
bentoml 1.2.15
BentoML: Build Production-Grade AI Applications
146 versions - Latest release: about 11 hours ago - 10 dependent packages - 499 dependent repositories - 85.7 thousand downloads last month - 6,561 stars on GitHub - 4 maintainers
mlrun-pipelines-kfp-common-experiment 0.1.3
MLRun Pipelines package for providing KFP 1.8 compatibility
4 versions - Latest release: 27 days ago - 1.06 thousand downloads last month - 1,309 stars on GitHub - 2 maintainers
mlrun-pipelines-kfp-v1-8-experiment 0.1.3
MLRun Pipelines package for providing KFP 1.8 compatibility
3 versions - Latest release: 27 days ago - 933 downloads last month - 1,309 stars on GitHub - 4 maintainers
mlrun-pipelines-kfp-v2-experiment 0.1.2
MLRun Pipelines package for providing KFP 2.* compatibility
3 versions - Latest release: 20 days ago - 366 downloads last month - 1,309 stars on GitHub - 2 maintainers
Top 4.4% on pypi.org
envd 0.3.45
A development environment management tool for data scientists.
106 versions - Latest release: 4 months ago - 3 dependent packages - 5 dependent repositories - 37.5 thousand downloads last month - 1,909 stars on GitHub - 3 maintainers
Top 3.6% on pypi.org
truss 0.9.11
A seamless bridge from model development to model delivery
211 versions - Latest release: 1 day ago - 2 dependent packages - 5 dependent repositories - 37 thousand downloads last month - 839 stars on GitHub - 6 maintainers
Top 1.4% on pypi.org
kserve 0.12.1
KServe Python SDK
25 versions - Latest release: 19 days ago - 9 dependent packages - 178 dependent repositories - 46.5 thousand downloads last month - 3,025 stars on GitHub - 1 maintainer
hopsml 2.4.1
HSML: An environment independent client to interact with the Hopsworks Model Registry
1 version - Latest release: over 2 years ago - 1 dependent repositories - 8 downloads last month - 8 stars on GitHub - 1 maintainer
hsmltestfix 2.4.1
HSML: An environment independent client to interact with the Hopsworks Model Registry
2 versions - Latest release: over 2 years ago - 1 dependent repositories - 25 downloads last month - 8 stars on GitHub - 1 maintainer
hsmlfix 2.5.1
HSML: An environment independent client to interact with the Hopsworks Model Registry
3 versions - Latest release: over 2 years ago - 1 dependent repositories - 15 downloads last month - 8 stars on GitHub - 2 maintainers
Top 8.6% on pypi.org
hsml 3.7.1
HSML: An environment independent client to interact with the Hopsworks Model Registry
34 versions - Latest release: 11 days ago - 1 dependent package - 5 dependent repositories - 9.87 thousand downloads last month - 8 stars on GitHub - 2 maintainers
hsml-test 2.4.1
HSML: An environment independent client to interact with the Hopsworks Model Registry
2 versions - Latest release: over 2 years ago - 1 dependent repositories - 13 downloads last month - 8 stars on GitHub - 1 maintainer
Top 4.1% on pypi.org
mlrun 1.6.2
Tracking and config of machine learning runs
537 versions - Latest release: about 1 month ago - 9 dependent repositories - 21.9 thousand downloads last month - 1,306 stars on GitHub - 3 maintainers
google-jetstream 0.2.1
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting ...
4 versions - Latest release: 6 days ago - 11.6 thousand downloads last month - 126 stars on GitHub - 2 maintainers
tfservingspark 0.1.0
Tensorflow serving on spark dataframe
1 version - Latest release: about 6 years ago - 1 dependent repositories - 23 downloads last month - 7 stars on GitHub - 1 maintainer
mlserve 0.0.1a6
mlserve -- turns python model into RESTful API with automatically generated UI.
6 versions - Latest release: over 5 years ago - 1 dependent repositories - 26 downloads last month - 26 stars on GitHub - 2 maintainers
sentencebertservice 20211205152102
BentoML generated model module
1 version - Latest release: over 2 years ago - 1 dependent repositories - 17 downloads last month - 6,558 stars on GitHub - 1 maintainer
bentoml-core 0.1.0
The rust core of BentoML: The Unified Model Serving Framework
2 versions - Latest release: 12 months ago - 34 downloads last month - 6,558 stars on GitHub - 4 maintainers
yatai 0.0.1
Model and deployment management for BentoML
1 version - Latest release: almost 3 years ago - 1 dependent repositories - 33 downloads last month - 6,558 stars on GitHub - 2 maintainers
Top 7.9% on pypi.org
chitra 0.2.0 💰
A multi functional library for full stack Deep Learning.
38 versions - Latest release: over 2 years ago - 1 dependent package - 3 dependent repositories - 2.51 thousand downloads last month - 224 stars on GitHub - 2 maintainers
fasttext-serving 0.2.0 💰
fasttext-serving gRPC client
3 versions - Latest release: over 3 years ago - 1 dependent repositories - 33 downloads last month - 58 stars on GitHub - 1 maintainer
fasttext-serving-server 0.6.2 💰
fastText model serving API server
1 version - Latest release: about 3 years ago - 1 dependent repositories - 22 downloads last month - 58 stars on GitHub - 2 maintainers
lorax-client 0.5.0
LoRAX Python Client
8 versions - Latest release: 16 days ago - 2.06 thousand downloads last month - 516 stars on GitHub - 2 maintainers
titus2 1.2.1
Python 3 implementation of Portable Format for Analytics (PFA): producer, converter, and consumer.
5 versions - Latest release: about 1 year ago - 2 dependent repositories - 45 downloads last month - 23 stars on GitHub - 2 maintainers
ventu 0.4.5 💰
Host your deep learning models easily.
9 versions - Latest release: almost 4 years ago - 1 dependent repositories - 66 downloads last month - 9 stars on GitHub - 2 maintainers
pinference 0.1.0b1
Aims to be the Simplest Machine Learning Model Inference Server
1 version - Latest release: about 2 years ago - 1 dependent repositories - 13 downloads last month - 557 stars on GitHub - 1 maintainer
pinferencia 0.2.1
Aims to be the Simplest Machine Learning Model Inference Server
15 versions - Latest release: over 1 year ago - 1 dependent repositories - 110 downloads last month - 557 stars on GitHub - 1 maintainer
mosec-tiinfer 0.0.7
Model Serving made Efficient in the Cloud.
1 version - Latest release: about 1 year ago - 41 downloads last month - 705 stars on GitHub - 2 maintainers
Top 7.4% on pypi.org
mosec 0.8.4
Model Serving made Efficient in the Cloud
41 versions - Latest release: 2 months ago - 1 dependent package - 1 dependent repositories - 2.62 thousand downloads last month - 657 stars on GitHub - 2 maintainers
Top 3.3% on pypi.org
kfserving 0.6.1
KFServing Python SDK
20 versions - Latest release: over 2 years ago - 182 dependent repositories - 5.56 thousand downloads last month - 2,887 stars on GitHub - 4 maintainers
rungpt 0.1.1
An open-source cloud-native of large multi-modal models (LMMs) serving framework.
2 versions - Latest release: 8 months ago - 43 downloads last month - 134 stars on GitHub - 2 maintainers
open-gpt-torch 0.0.13
An open-source cloud-native of large multi-modal models (LMMs) serving framework.
27 versions - Latest release: 10 months ago - 127 downloads last month - 134 stars on GitHub - 2 maintainers
mldrop-client 0.1.1
Python client for MLDrop by Scattering AI
2 versions - Latest release: about 1 year ago - 9 downloads last month - 3 stars on GitHub - 2 maintainers
Top 7.7% on pypi.org
monai-deploy-app-sdk 2.0.0
A framework and associated tools to design, verify and analyze performance of MONAI apps
16 versions - Latest release: 15 days ago - 6 dependent repositories - 900 downloads last month - 80 stars on GitHub - 6 maintainers
Top 2.8% on pypi.org
ovmsclient 2023.1
Python client for OpenVINO Model Server
6 versions - Latest release: 8 months ago - 5 dependent packages - 24 dependent repositories - 17.2 thousand downloads last month - 635 stars on GitHub - 1 maintainer
fdclient 3.0.5
fastDeploy python client
7 versions - Latest release: about 2 months ago - 58 downloads last month - 90 stars on GitHub - 2 maintainers
fastdeploy 3.0.13
Deploy DL/ ML inference pipelines with minimal extra code.
69 versions - Latest release: 18 days ago - 1 dependent repositories - 650 downloads last month - 90 stars on GitHub - 2 maintainers
lmao 1.18
Client library for working with NimbleBox LMAO
1 version - Latest release: over 1 year ago - 8 downloads last month - 88 stars on GitHub - 2 maintainers
nimblebox 0.9.16
ML Inference 🥶
2 versions - Latest release: almost 2 years ago - 1 dependent repositories - 13 downloads last month - 89 stars on GitHub - 2 maintainers
dainik 0.0.0
Client library for working with NimbleBox LMAO
17 versions - Latest release: almost 2 years ago - 64 downloads last month - 88 stars on GitHub - 2 maintainers
tftree 0.1.8 💰
Tree to tensorflow
8 versions - Latest release: about 4 years ago - 1 dependent repositories - 56 downloads last month - 9 stars on GitHub - 2 maintainers
Top 8.9% on pypi.org
nbox 0.12.4
ML Inference 🥶
317 versions - Latest release: about 1 year ago - 2 dependent repositories - 1.47 thousand downloads last month - 88 stars on GitHub - 1 maintainer
kedro-serving 0.0.1
A kedro plugin to serve kedro pipelines
1 version - Latest release: over 2 years ago - 1 dependent repositories - 9 downloads last month - 13 stars on GitHub - 1 maintainer
monai-app-sdk 0.0.0
A framework and associated tools to design, verify and analyze performance of MONAI apps
1 version - Latest release: almost 3 years ago - 1 dependent repositories - 13 downloads last month - 80 stars on GitHub - 1 maintainer
krypton-ml 0.1.1
Model Server for ML and DL Models built using FastAPI
2 versions - Latest release: almost 4 years ago - 1 dependent repositories - 9 downloads last month - 4 stars on GitHub - 2 maintainers
onediffusion 0.0.3
Onediffusion: REST API server for running any diffusion models - Stable Diffusion, Anything, Cont...
3 versions - Latest release: 8 months ago - 48 downloads last month - 317 stars on GitHub - 3 maintainers
kserve-mathking 0.10.0rc3
KServe Python SDK
3 versions - Latest release: over 1 year ago - 13 downloads last month - 2,673 stars on GitHub - 1 maintainer
Top 7.7% on pypi.org
clearml-serving 1.3.0
clearml-serving - Model-Serving Orchestration and Repository Solution
9 versions - Latest release: about 1 year ago - 3 dependent repositories - 1.37 thousand downloads last month - 124 stars on GitHub - 1 maintainer
surround-cli 0.0.5
Command line interface for Surround
5 versions - Latest release: over 2 years ago - 1 dependent repositories - 24 downloads last month - 22 stars on GitHub - 2 maintainers
surround 0.1.2
Surround is a framework for serving machine learning pipelines in Python.
17 versions - Latest release: over 2 years ago - 6 dependent repositories - 59 downloads last month - 22 stars on GitHub - 2 maintainers
clip-api-service 0.1.3
Build AI applications with any CLIP models - embed image and sentences, object recognition, visua...
3 versions - Latest release: 7 months ago - 19 downloads last month - 35 stars on GitHub - 3 maintainers
modzy-sdk 0.11.6
Modzy's Python SDK queries and deploys models, submits inference jobs and returns results directl...
28 versions - Latest release: 8 months ago - 2 dependent repositories - 69 downloads last month - 23 stars on GitHub - 2 maintainers