Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "model-serving" keyword

titus2 1.2.1
Python 3 implementation of Portable Format for Analytics (PFA): producer, converter, and consumer.
5 versions - Latest release: over 1 year ago - 2 dependent repositories - 51 downloads last month - 23 stars on GitHub - 1 maintainer
Top 7.9% on pypi.org
chitra 0.2.0 💰
A multi functional library for full stack Deep Learning.
38 versions - Latest release: over 2 years ago - 1 dependent package - 3 dependent repositories - 1.28 thousand downloads last month - 224 stars on GitHub - 1 maintainer
Top 3.4% on pypi.org
vllm 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs
27 versions - Latest release: 28 days ago - 46 dependent packages - 5 dependent repositories - 408 thousand downloads last month - 17,633 stars on GitHub - 2 maintainers
mosec-tiinfer 0.0.7
Model Serving made Efficient in the Cloud.
1 version - Latest release: about 1 year ago - 18 downloads last month - 712 stars on GitHub - 1 maintainer
Top 7.4% on pypi.org
mosec 0.8.4
Model Serving made Efficient in the Cloud
42 versions - Latest release: 3 months ago - 1 dependent package - 1 dependent repositories - 1.59 thousand downloads last month - 657 stars on GitHub - 2 maintainers
fedml-afaf 0.7.327 💰
A research and production integrated edge-cloud library for federated/distributed machine learnin...
1 version - Latest release: over 1 year ago - 28 downloads last month - 3,931 stars on GitHub - 1 maintainer
Top 3.2% on pypi.org
fedml 0.8.30 💰
A research and production integrated edge-cloud library for federated/distributed machine learnin...
350 versions - Latest release: about 1 month ago - 1 dependent package - 9 dependent repositories - 22.1 thousand downloads last month - 3,930 stars on GitHub - 2 maintainers
google-jetstream 0.2.1
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting ...
5 versions - Latest release: 29 days ago - 11.6 thousand downloads last month - 126 stars on GitHub - 1 maintainer
Top 4.4% on pypi.org
envd 0.3.45
A development environment management tool for data scientists.
106 versions - Latest release: 4 months ago - 3 dependent packages - 5 dependent repositories - 19.6 thousand downloads last month - 1,909 stars on GitHub - 3 maintainers
pinferencia 0.2.1
Aims to be the Simplest Machine Learning Model Inference Server
15 versions - Latest release: almost 2 years ago - 1 dependent repositories - 83 downloads last month - 558 stars on GitHub - 1 maintainer
pinference 0.1.0b1
Aims to be the Simplest Machine Learning Model Inference Server
1 version - Latest release: about 2 years ago - 1 dependent repositories - 12 downloads last month - 558 stars on GitHub - 1 maintainer
Top 3.6% on pypi.org
truss 0.9.11
A seamless bridge from model development to model delivery
218 versions - Latest release: 24 days ago - 2 dependent packages - 5 dependent repositories - 28 thousand downloads last month - 844 stars on GitHub - 6 maintainers
vllm-acc 0.4.1
A high-throughput and memory-efficient inference and serving engine for LLMs
8 versions - Latest release: 29 days ago - 1.4 thousand downloads last month - 17,633 stars on GitHub - 1 maintainer
vllm-xft 0.3.3.1
A high-throughput and memory-efficient inference and serving engine for LLMs
2 versions - Latest release: 23 days ago - 113 downloads last month - 17,633 stars on GitHub - 2 maintainers
hive-vllm 0.0.1
a
1 version - Latest release: 3 months ago - 10 downloads last month - 17,633 stars on GitHub - 1 maintainer
vllm-online 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs
2 versions - Latest release: about 1 month ago - 60 downloads last month - 17,633 stars on GitHub - 1 maintainer
tilearn-test01 0.1
A high-throughput and memory-efficient inference and serving engine for LLMs
1 version - Latest release: about 2 months ago - 9 downloads last month - 17,633 stars on GitHub - 1 maintainer
llm-swarm 0.1.1
A high-throughput and memory-efficient inference and serving engine for LLMs
2 versions - Latest release: 3 months ago - 53 downloads last month - 17,633 stars on GitHub - 1 maintainer
tilearn-infer 0.3.3
A high-throughput and memory-efficient inference and serving engine for LLMs
3 versions - Latest release: about 1 month ago - 20 downloads last month - 17,633 stars on GitHub - 1 maintainer
llm_atc 0.1.7
Tools for fine tuning and serving LLMs
6 versions - Latest release: 6 months ago - 32 downloads last month - 17,633 stars on GitHub - 1 maintainer
nextai-vllm 0.0.7
A high-throughput and memory-efficient inference and serving engine for LLMs
6 versions - Latest release: about 1 month ago - 41 downloads last month - 17,633 stars on GitHub - 1 maintainer
superlaser 0.0.6
An MLOps library for LLM deployment w/ the vLLM engine on RunPod's infra.
6 versions - Latest release: 3 months ago - 42 downloads last month - 17,633 stars on GitHub - 1 maintainer
vllm-consul 0.2.1
A high-throughput and memory-efficient inference and serving engine for LLMs
5 versions - Latest release: 7 months ago - 22 downloads last month - 12,665 stars on GitHub - 1 maintainer
Top 1.4% on pypi.org
kserve 0.12.1
KServe Python SDK
26 versions - Latest release: about 1 month ago - 10 dependent packages - 178 dependent repositories - 46.9 thousand downloads last month - 3,025 stars on GitHub - 1 maintainer
Top 4.1% on pypi.org
mlrun 1.6.2
Tracking and config of machine learning runs
544 versions - Latest release: 2 months ago - 1 dependent package - 9 dependent repositories - 21.9 thousand downloads last month - 1,318 stars on GitHub - 2 maintainers
Top 2.8% on pypi.org
ovmsclient 2023.1
Python client for OpenVINO Model Server
6 versions - Latest release: 9 months ago - 5 dependent packages - 24 dependent repositories - 18.2 thousand downloads last month - 635 stars on GitHub - 1 maintainer
open-gpt-torch 0.0.13
An open-source cloud-native of large multi-modal models (LMMs) serving framework.
27 versions - Latest release: 11 months ago - 128 downloads last month - 137 stars on GitHub - 1 maintainer
Top 1.2% on pypi.org
bentoml 1.2.16
BentoML: Build Production-Grade AI Applications
147 versions - Latest release: 17 days ago - 13 dependent packages - 499 dependent repositories - 105 thousand downloads last month - 6,591 stars on GitHub - 3 maintainers
mldrop-client 0.1.1
Python client for MLDrop by Scattering AI
2 versions - Latest release: over 1 year ago - 5 downloads last month - 3 stars on GitHub - 1 maintainer
rungpt 0.1.1
An open-source cloud-native of large multi-modal models (LMMs) serving framework.
2 versions - Latest release: 9 months ago - 34 downloads last month - 137 stars on GitHub - 1 maintainer
lorax-client 0.5.1
LoRAX Python Client
10 versions - Latest release: 17 days ago - 8.2 thousand downloads last month - 516 stars on GitHub - 1 maintainer
fastdeploy 3.0.13
Deploy DL/ ML inference pipelines with minimal extra code.
70 versions - Latest release: about 1 month ago - 1 dependent repositories - 903 downloads last month - 91 stars on GitHub - 1 maintainer
fdclient 3.0.5
fastDeploy python client
7 versions - Latest release: 3 months ago - 63 downloads last month - 91 stars on GitHub - 1 maintainer
nimblebox 0.9.16
ML Inference 🥶
2 versions - Latest release: almost 2 years ago - 1 dependent repositories - 17 downloads last month - 88 stars on GitHub - 1 maintainer
dainik 0.0.0
Client library for working with NimbleBox LMAO
17 versions - Latest release: almost 2 years ago - 87 downloads last month - 88 stars on GitHub - 1 maintainer
lmao 1.18
Client library for working with NimbleBox LMAO
1 version - Latest release: almost 2 years ago - 10 downloads last month - 88 stars on GitHub - 1 maintainer
Top 8.9% on pypi.org
nbox 0.12.4
ML Inference 🥶
317 versions - Latest release: about 1 year ago - 2 dependent repositories - 2.05 thousand downloads last month - 88 stars on GitHub - 1 maintainer
tftree 0.1.8 💰
Tree to tensorflow
8 versions - Latest release: over 4 years ago - 1 dependent repositories - 53 downloads last month - 9 stars on GitHub - 1 maintainer
kedro-serving 0.0.1
A kedro plugin to serve kedro pipelines
1 version - Latest release: over 2 years ago - 1 dependent repositories - 10 downloads last month - 13 stars on GitHub - 1 maintainer
monai-app-sdk 0.0.0
A framework and associated tools to design, verify and analyze performance of MONAI apps
1 version - Latest release: almost 3 years ago - 1 dependent repositories - 10 downloads last month - 83 stars on GitHub - 1 maintainer
mlrun-pipelines-kfp-v2-experiment 0.2.0
MLRun Pipelines package for providing KFP 2.* compatibility
5 versions - Latest release: 20 days ago - 1.16 thousand downloads last month - 1,318 stars on GitHub - 1 maintainer
mlrun-pipelines-kfp-common-experiment 0.2.0
MLRun Pipelines package for providing KFP 1.8 compatibility
6 versions - Latest release: 20 days ago - 7.8 thousand downloads last month - 1,318 stars on GitHub - 1 maintainer
mlrun-pipelines-kfp-v1-8-experiment 0.2.2
MLRun Pipelines package for providing KFP 1.8 compatibility
8 versions - Latest release: 17 days ago - 7.07 thousand downloads last month - 1,318 stars on GitHub - 2 maintainers
krypton-ml 0.1.1
Model Server for ML and DL Models built using FastAPI
2 versions - Latest release: almost 4 years ago - 1 dependent repositories - 27 downloads last month - 4 stars on GitHub - 1 maintainer
onediffusion 0.0.3
Onediffusion: REST API server for running any diffusion models - Stable Diffusion, Anything, Cont...
3 versions - Latest release: 9 months ago - 57 downloads last month - 317 stars on GitHub - 2 maintainers
kserve-mathking 0.10.0rc3
KServe Python SDK
3 versions - Latest release: over 1 year ago - 38 downloads last month - 2,673 stars on GitHub - 1 maintainer
Top 7.7% on pypi.org
clearml-serving 1.3.0
clearml-serving - Model-Serving Orchestration and Repository Solution
9 versions - Latest release: about 1 year ago - 3 dependent repositories - 1.9 thousand downloads last month - 124 stars on GitHub - 1 maintainer
surround-cli 0.0.5
Command line interface for Surround
5 versions - Latest release: almost 3 years ago - 1 dependent repositories - 56 downloads last month - 22 stars on GitHub - 1 maintainer
surround 0.1.2
Surround is a framework for serving machine learning pipelines in Python.
17 versions - Latest release: almost 3 years ago - 6 dependent repositories - 181 downloads last month - 22 stars on GitHub - 1 maintainer
hsmltestfix 2.4.1
HSML: An environment independent client to interact with the Hopsworks Model Registry
2 versions - Latest release: over 2 years ago - 1 dependent repositories - 27 downloads last month - 8 stars on GitHub - 1 maintainer
hsmlfix 2.5.1
HSML: An environment independent client to interact with the Hopsworks Model Registry
3 versions - Latest release: over 2 years ago - 1 dependent repositories - 22 downloads last month - 8 stars on GitHub - 1 maintainer
hsml-test 2.4.1
HSML: An environment independent client to interact with the Hopsworks Model Registry
2 versions - Latest release: over 2 years ago - 1 dependent repositories - 16 downloads last month - 8 stars on GitHub - 1 maintainer
Top 8.6% on pypi.org
hsml 3.7.1
HSML: An environment independent client to interact with the Hopsworks Model Registry
34 versions - Latest release: about 1 month ago - 1 dependent package - 5 dependent repositories - 11.2 thousand downloads last month - 8 stars on GitHub - 2 maintainers
hopsml 2.4.1
HSML: An environment independent client to interact with the Hopsworks Model Registry
1 version - Latest release: over 2 years ago - 1 dependent repositories - 13 downloads last month - 8 stars on GitHub - 1 maintainer
Top 7.7% on pypi.org
monai-deploy-app-sdk 2.0.0
A framework and associated tools to design, verify and analyze performance of MONAI apps
16 versions - Latest release: about 1 month ago - 6 dependent repositories - 883 downloads last month - 83 stars on GitHub - 3 maintainers
clip-api-service 0.1.3
Build AI applications with any CLIP models - embed image and sentences, object recognition, visua...
3 versions - Latest release: 8 months ago - 50 downloads last month - 36 stars on GitHub - 2 maintainers
bentoml-core 0.1.0
The rust core of BentoML: The Unified Model Serving Framework
2 versions - Latest release: about 1 year ago - 35 downloads last month - 6,591 stars on GitHub - 2 maintainers
yatai 0.0.1
Model and deployment management for BentoML
1 version - Latest release: almost 3 years ago - 1 dependent repositories - 32 downloads last month - 6,591 stars on GitHub - 1 maintainer
ventu 0.4.5 💰
Host your deep learning models easily.
9 versions - Latest release: almost 4 years ago - 1 dependent repositories - 66 downloads last month - 9 stars on GitHub - 1 maintainer
mlserve 0.0.1a6
mlserve -- turns python model into RESTful API with automatically generated UI.
6 versions - Latest release: almost 6 years ago - 1 dependent repositories - 26 downloads last month - 26 stars on GitHub - 1 maintainer
fasttext-serving-server 0.6.2 💰
fastText model serving API server
1 version - Latest release: about 3 years ago - 1 dependent repositories - 22 downloads last month - 58 stars on GitHub - 1 maintainer
sentencebertservice 20211205152102
BentoML generated model module
1 version - Latest release: over 2 years ago - 1 dependent repositories - 26 downloads last month - 6,591 stars on GitHub - 1 maintainer
modzy-sdk 0.11.6
Modzy's Python SDK queries and deploys models, submits inference jobs and returns results directl...
28 versions - Latest release: 9 months ago - 2 dependent repositories - 197 downloads last month - 23 stars on GitHub - 2 maintainers
Top 3.3% on pypi.org
kfserving 0.6.1
KFServing Python SDK
20 versions - Latest release: over 2 years ago - 182 dependent repositories - 4.04 thousand downloads last month - 3,025 stars on GitHub - 4 maintainers
tfservingspark 0.1.0
Tensorflow serving on spark dataframe
1 version - Latest release: about 6 years ago - 1 dependent repositories - 23 downloads last month - 7 stars on GitHub - 1 maintainer
fasttext-serving 0.2.0 💰
fasttext-serving gRPC client
3 versions - Latest release: over 3 years ago - 1 dependent repositories - 33 downloads last month - 58 stars on GitHub - 1 maintainer