hex.pm "batching" keyword
batch_loader 0.1.0-beta.6
Powerful tool to avoid N+1 DB or HTTP queries6 versions - Latest release: over 6 years ago - 1 dependent repositories - 9.96 thousand downloads total - 19 stars on GitHub - 1 maintainer
vllm 0.3.0
vLLM for Elixir via SnakeBridge - Easy, fast, and cheap LLM serving for everyone. High-throughput...5 versions - Latest release: 4 months ago - 216 downloads total - 0 stars on GitHub - 1 maintainer
Related Keywords
absinthe
1
dataloader
1
elixir
1
graphql
1
nplus1
1
package
1
ai
1
attention
1
cuda
1
deep-learning
1
distributed-systems
1
gpu
1
inference
1
language-model
1
llm
1
machine-learning
1
natural-language-processing
1
nshkr-ai-sdk
1
openai-api
1
paged-attention
1
pytorch
1
quantization
1
serving
1
tensor-parallelism
1
transformer
1