pypi.org "Model Serving" keyword
Top 2.2% on pypi.org
195 versions - Latest release: over 1 year ago - 3 dependent packages - 295 dependent repositories - 1.5 thousand downloads last month - 12,583 stars on GitHub - 3 maintainers
openllm 0.6.30
OpenLLM: Self-hosting LLMs Made Easy.195 versions - Latest release: over 1 year ago - 3 dependent packages - 295 dependent repositories - 1.5 thousand downloads last month - 12,583 stars on GitHub - 3 maintainers
Top 3.9% on pypi.org
85 versions - Latest release: over 2 years ago - 2 dependent packages - 8 dependent repositories - 939 downloads last month - 12,583 stars on GitHub - 1 maintainer
openllm-client 0.5.7
OpenLLM Client: Interacting with OpenLLM HTTP/gRPC server, or any BentoML server.85 versions - Latest release: over 2 years ago - 2 dependent packages - 8 dependent repositories - 939 downloads last month - 12,583 stars on GitHub - 1 maintainer
Top 3.5% on pypi.org
85 versions - Latest release: over 2 years ago - 2 dependent packages - 8 dependent repositories - 445 downloads last month - 12,583 stars on GitHub - 1 maintainer
openllm-core 0.5.7
OpenLLM Core: Core components for OpenLLM.85 versions - Latest release: over 2 years ago - 2 dependent packages - 8 dependent repositories - 445 downloads last month - 12,583 stars on GitHub - 1 maintainer
genai_stack 0.2.6
End-to-End Secure & Private Generative AI for All2 versions - Latest release: about 3 years ago - 10 downloads last month - 131 stars on GitHub - 1 maintainer
Top 1.2% on pypi.org
220 versions - Latest release: 20 days ago - 13 dependent packages - 499 dependent repositories - 134 thousand downloads last month - 8,935 stars on GitHub - 4 maintainers
bentoml 1.4.40
BentoML: The easiest way to serve AI apps and models220 versions - Latest release: 20 days ago - 13 dependent packages - 499 dependent repositories - 134 thousand downloads last month - 8,935 stars on GitHub - 4 maintainers
Top 3.6% on pypi.org
1,236 versions - Latest release: 2 days ago - 2 dependent packages - 5 dependent repositories - 294 thousand downloads last month - 1,227 stars on GitHub - 7 maintainers
truss 0.18.40
A seamless bridge from model development to model delivery1,236 versions - Latest release: 2 days ago - 2 dependent packages - 5 dependent repositories - 294 thousand downloads last month - 1,227 stars on GitHub - 7 maintainers
aihero 0.5.1
AI Hero Python SDK25 versions - Latest release: over 2 years ago - 154 downloads last month - 5 stars on GitHub - 1 maintainer
bentoml-unsloth 0.1.2
BentoML: The easiest way to serve AI apps and models3 versions - Latest release: about 2 years ago - 22 downloads last month - 8,935 stars on GitHub - 1 maintainer
bentoml-core 0.1.0
The rust core of BentoML: The Unified Model Serving Framework2 versions - Latest release: over 3 years ago - 21 downloads last month - 8,935 stars on GitHub - 2 maintainers
truss-lib 0.10.0rc3
A seamless bridge from model development to model delivery4 versions - Latest release: almost 2 years ago - 20 downloads last month - 1,227 stars on GitHub - 1 maintainer
aigear 0.2.1
Closes the gap between model development and production deployment by automating GCP infrastructu...5 versions - Latest release: 3 months ago - 61 downloads last month - 5 stars on GitHub - 1 maintainer
nidam 0.1.0
Nidam: Self-hosting LLMs Made Easy.1 version - Latest release: over 1 year ago - 19 downloads last month - 1 maintainer
kcai-bentoml 1.0.22 removed
BentoML: The Unified Model Serving Framework4 versions - Latest release: over 3 years ago - 152 downloads last month - 1 maintainer
bentoml-plugins-arize 0.1.0
BentoML Monitoring Arize Plugin1 version - Latest release: almost 4 years ago - 36 downloads last month - 6 stars on GitHub - 2 maintainers
onediffusion 0.0.3
Onediffusion: REST API server for running any diffusion models - Stable Diffusion, Anything, Cont...3 versions - Latest release: about 3 years ago - 39 downloads last month - 389 stars on GitHub - 2 maintainers
Related Keywords
MLOps
15
Model Deployment
15
AI
13
BentoML
9
mlops
8
LLMOps
7
llm
7
llmops
7
model-serving
6
Generative AI
6
llm-serving
6
llm-inference
6
machine-learning
5
PyTorch
5
Large Language Model
5
Transformers
5
Falcon
4
llama
4
Vicuna
4
Llama 2
4
Fine tuning
4
Serverless
4
StableLM
4
Alpaca
4
bentoml
4
fine-tuning
4
llama3-1
3
llama2
3
ai-inference
3
deep-learning
3
llama3-2
3
llama3-2-vision
3
generative-ai
3
inference-platform
3
ml-engineering
3
model-inference-service
3
multimodal
3
python
3
llm-ops
3
mistral
3
model-inference
3
open-source-llm
3
openllm
3
vicuna
3
stable-diffusion
3
open-source
2
inference-server
2
inference-api
2
falcon
2
easy-to-use
2
artificial-intelligence
2
Machine Learning
2
vLLM
2
Mistral
2
packaging
2
whisper
2
wizardlm
2
Model Training
2
Compound AI Systems
2
Model Inference
2
ai
2
bazel
1
nix
1
ML
1
AI Hero
1
Spotcheck
1
Data Annotation
1
Labeling
1
LLM Chat
1
data-engineering
1
datascientist
1
genai
1
hacktoberfest
1
hacktoberfest-accepted
1
hacktoberfest2023
1
langchain
1
chatgpt
1
llama-index
1
JILE
1
gpt4all
1
GenAI Stack
1
Diffusers
1
Lora
1
Stable Diffusion
1
diffusion-models
1
kubernetes
1
lora
1