pypi.org "Model Serving" keyword
View the packages on the pypi.org package registry that are tagged with the "Model Serving" keyword.
Top 2.2% on pypi.org
195 versions - Latest release: 5 months ago - 3 dependent packages - 295 dependent repositories - 8.47 thousand downloads last month - 8,657 stars on GitHub - 3 maintainers
openllm 0.6.30
OpenLLM: Self-hosting LLMs Made Easy.195 versions - Latest release: 5 months ago - 3 dependent packages - 295 dependent repositories - 8.47 thousand downloads last month - 8,657 stars on GitHub - 3 maintainers
Top 3.9% on pypi.org
85 versions - Latest release: about 1 year ago - 2 dependent packages - 8 dependent repositories - 453 downloads last month - 8,657 stars on GitHub - 1 maintainer
openllm-client 0.5.7
OpenLLM Client: Interacting with OpenLLM HTTP/gRPC server, or any BentoML server.85 versions - Latest release: about 1 year ago - 2 dependent packages - 8 dependent repositories - 453 downloads last month - 8,657 stars on GitHub - 1 maintainer
Top 3.5% on pypi.org
85 versions - Latest release: about 1 year ago - 2 dependent packages - 8 dependent repositories - 1.36 thousand downloads last month - 8,657 stars on GitHub - 1 maintainer
openllm-core 0.5.7
OpenLLM Core: Core components for OpenLLM.85 versions - Latest release: about 1 year ago - 2 dependent packages - 8 dependent repositories - 1.36 thousand downloads last month - 8,657 stars on GitHub - 1 maintainer
Top 1.2% on pypi.org
203 versions - Latest release: 3 days ago - 13 dependent packages - 499 dependent repositories - 106 thousand downloads last month - 6,591 stars on GitHub - 3 maintainers
bentoml 1.4.23
BentoML: The easiest way to serve AI apps and models203 versions - Latest release: 3 days ago - 13 dependent packages - 499 dependent repositories - 106 thousand downloads last month - 6,591 stars on GitHub - 3 maintainers
genai_stack 0.2.6
End-to-End Secure & Private Generative AI for All2 versions - Latest release: almost 2 years ago - 25 downloads last month - 125 stars on GitHub - 1 maintainer
bentoml-unsloth 0.1.2
BentoML: The easiest way to serve AI apps and models3 versions - Latest release: 12 months ago - 125 downloads last month - 8,028 stars on GitHub - 1 maintainer
bentoml-core 0.1.0
The rust core of BentoML: The Unified Model Serving Framework2 versions - Latest release: over 2 years ago - 39 downloads last month - 8,028 stars on GitHub - 2 maintainers
Top 3.6% on pypi.org
813 versions - Latest release: 7 months ago - 2 dependent packages - 5 dependent repositories - 126 thousand downloads last month - 911 stars on GitHub - 6 maintainers
truss 0.60.0
A seamless bridge from model development to model delivery813 versions - Latest release: 7 months ago - 2 dependent packages - 5 dependent repositories - 126 thousand downloads last month - 911 stars on GitHub - 6 maintainers
truss-lib 0.10.0rc3
A seamless bridge from model development to model delivery4 versions - Latest release: 10 months ago - 20 downloads last month - 1,056 stars on GitHub - 1 maintainer
Top 6.5% on pypi.org
115 versions - Latest release: almost 3 years ago - 2 dependent repositories - 1.46 thousand downloads last month - 4 maintainers
baseten 2.0.9
Deploy machine learning models to Baseten115 versions - Latest release: almost 3 years ago - 2 dependent repositories - 1.46 thousand downloads last month - 4 maintainers
bentoml-plugins-arize 0.1.0
BentoML Monitoring Arize Plugin1 version - Latest release: almost 3 years ago - 33 downloads last month - 6 stars on GitHub - 2 maintainers
aihero 0.5.1
AI Hero Python SDK25 versions - Latest release: about 1 year ago - 145 downloads last month - 5 stars on GitHub - 1 maintainer
nidam 0.1.0
Nidam: Self-hosting LLMs Made Easy.1 version - Latest release: 7 months ago - 14 downloads last month - 1 maintainer
onediffusion 0.0.3
Onediffusion: REST API server for running any diffusion models - Stable Diffusion, Anything, Cont...3 versions - Latest release: almost 2 years ago - 32 downloads last month - 369 stars on GitHub - 2 maintainers
kcai-bentoml 1.0.20.post1 removed
BentoML: The Unified Model Serving Framework4 versions - Latest release: about 2 years ago - 152 downloads last month - 1 maintainer
Related Keywords
MLOps
15
Model Deployment
15
AI
13
BentoML
9
mlops
8
LLMOps
7
llmops
7
llm
7
model-serving
6
Generative AI
6
llm-serving
6
llm-inference
6
machine-learning
5
falcon
5
ai
5
Large Language Model
5
PyTorch
5
Transformers
5
StableLM
4
bentoml
4
Serverless
4
fine-tuning
4
llama
4
Vicuna
4
Llama 2
4
Alpaca
4
Falcon
4
Fine tuning
4
llm-ops
3
deep-learning
3
generative-ai
3
inference-platform
3
ml-engineering
3
model-inference-service
3
multimodal
3
python
3
Machine Learning
3
stable-diffusion
3
mistral
3
ml
3
model-inference
3
mpt
3
open-source-llm
3
openllm
3
stablelm
3
llama2
3
vicuna
3
ai-inference
2
artificial-intelligence
2
easy-to-use
2
inference-api
2
inference-server
2
open-source
2
packaging
2
vLLM
2
whisper
2
wizardlm
2
Mistral
2
Model Inference
2
Compound AI Systems
2
nix
1
AI Hero
1
Spotcheck
1
Data Annotation
1
Labeling
1
Model Training
1
JILE
1
Diffusers
1
Lora
1
Stable Diffusion
1
diffusion-models
1
kubernetes
1
lora
1
bazel
1
llama-index
1
langchain
1
hacktoberfest2023
1
hacktoberfest-accepted
1
hacktoberfest
1
genai
1
datascientist
1
data-engineering
1
LLM Chat
1
chatgpt
1
gpt4all
1
GenAI Stack
1