Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "inference-platform" keyword

Top 1.2% on pypi.org
bentoml 1.4.40
BentoML: The easiest way to serve AI apps and models
220 versions - Latest release: 20 days ago - 13 dependent packages - 499 dependent repositories - 134 thousand downloads last month - 8,935 stars on GitHub - 4 maintainers
yatai 0.0.1
Model and deployment management for BentoML
1 version - Latest release: over 5 years ago - 1 dependent repositories - 37 downloads last month - 8,935 stars on GitHub - 1 maintainer
bentoml-unsloth 0.1.2
BentoML: The easiest way to serve AI apps and models
3 versions - Latest release: about 2 years ago - 22 downloads last month - 8,935 stars on GitHub - 1 maintainer
sentencebertservice 20211205152102
BentoML generated model module
1 version - Latest release: almost 5 years ago - 1 dependent repositories - 112 downloads last month - 8,935 stars on GitHub - 1 maintainer
bentoml-core 0.1.0
The rust core of BentoML: The Unified Model Serving Framework
2 versions - Latest release: over 3 years ago - 21 downloads last month - 8,935 stars on GitHub - 2 maintainers
llmaz 0.0.1 💰
☸️ Easy, advanced inference platform for large language models on Kubernetes
1 version - Latest release: almost 2 years ago - 14 downloads last month - 315 stars on GitHub - 1 maintainer
Related Keywords
llm 6 python 5 multimodal 5 model-serving 5 model-inference-service 5 mlops 5 ai-inference 5 deep-learning 5 generative-ai 5 llm-inference 5 llm-serving 5 llmops 5 machine-learning 5 ml-engineering 5 Model Deployment 3 Model Serving 3 BentoML 3 MLOps 3 Compound AI Systems 2 LLMOps 2 Model Inference 2 vllm 1 text-generation-inference 1 sglang 1 ollama 1 modelscope 1 llamacpp 1 kubernetes 1 inference 1 huggingface 1 AI 1