hex.pm "inference" keyword
vllm 0.3.0
vLLM for Elixir via SnakeBridge - Easy, fast, and cheap LLM serving for everyone. High-throughput...5 versions - Latest release: 4 months ago - 216 downloads total - 0 stars on GitHub - 1 maintainer
crucible_deployment 0.2.1
Model deployment orchestration with health checking and rollback3 versions - Latest release: 5 months ago - 164 downloads total - 0 stars on GitHub - 1 maintainer
Related Keywords
machine-learning
2
llm
2
deep-learning
2
ai
2
scholar
1
traffic-routing
1
research
1
phoenix
1
ollama
1
vllm
1
nx
1
nshkr-crucible
1
model-serving
1
model-deployment
1
mlops
1
ml-ops
1
elixir
1
canary-deployment
1
ab-testing
1
transformer
1
tensor-parallelism
1
serving
1
quantization
1
pytorch
1
paged-attention
1
openai-api
1
nshkr-ai-sdk
1
natural-language-processing
1
language-model
1
gpu
1
distributed-systems
1
cuda
1
batching
1
attention
1