Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

hex.pm "language-model" keyword

vllm 0.3.0
vLLM for Elixir via SnakeBridge - Easy, fast, and cheap LLM serving for everyone. High-throughput...
5 versions - Latest release: 4 months ago - 216 downloads total - 0 stars on GitHub - 1 maintainer
Related Keywords
ai 1 attention 1 batching 1 cuda 1 deep-learning 1 distributed-systems 1 gpu 1 inference 1 llm 1 machine-learning 1 natural-language-processing 1 nshkr-ai-sdk 1 openai-api 1 paged-attention 1 pytorch 1 quantization 1 serving 1 tensor-parallelism 1 transformer 1