Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "trainium" keyword

Top 3.4% on pypi.org
vllm 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs
27 versions - Latest release: 28 days ago - 46 dependent packages - 5 dependent repositories - 408 thousand downloads last month - 17,633 stars on GitHub - 2 maintainers
vllm-acc 0.4.1
A high-throughput and memory-efficient inference and serving engine for LLMs
8 versions - Latest release: 29 days ago - 1.4 thousand downloads last month - 17,633 stars on GitHub - 1 maintainer
vllm-xft 0.3.3.1
A high-throughput and memory-efficient inference and serving engine for LLMs
2 versions - Latest release: 23 days ago - 113 downloads last month - 17,633 stars on GitHub - 2 maintainers
hive-vllm 0.0.1
a
1 version - Latest release: 3 months ago - 10 downloads last month - 17,633 stars on GitHub - 1 maintainer
vllm-online 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs
2 versions - Latest release: about 1 month ago - 60 downloads last month - 17,633 stars on GitHub - 1 maintainer
tilearn-test01 0.1
A high-throughput and memory-efficient inference and serving engine for LLMs
1 version - Latest release: about 2 months ago - 9 downloads last month - 17,633 stars on GitHub - 1 maintainer
llm-swarm 0.1.1
A high-throughput and memory-efficient inference and serving engine for LLMs
2 versions - Latest release: 3 months ago - 53 downloads last month - 17,633 stars on GitHub - 1 maintainer
tilearn-infer 0.3.3
A high-throughput and memory-efficient inference and serving engine for LLMs
3 versions - Latest release: about 1 month ago - 20 downloads last month - 17,633 stars on GitHub - 1 maintainer
llm_atc 0.1.7
Tools for fine tuning and serving LLMs
6 versions - Latest release: 6 months ago - 32 downloads last month - 17,633 stars on GitHub - 1 maintainer
nextai-vllm 0.0.7
A high-throughput and memory-efficient inference and serving engine for LLMs
6 versions - Latest release: about 1 month ago - 41 downloads last month - 17,633 stars on GitHub - 1 maintainer
superlaser 0.0.6
An MLOps library for LLM deployment w/ the vLLM engine on RunPod's infra.
6 versions - Latest release: 3 months ago - 42 downloads last month - 17,633 stars on GitHub - 1 maintainer
Related Keywords
amd 11 cuda 11 gpt 11 inference 11 inferentia 11 llama 11 llm 11 llm-serving 11 llmops 11 mlops 11 model-serving 11 pytorch 11 rocm 11 transformer 11 server 1 LLM 1 NLP 1 MLOps 1 deployment 1 vllm 1 runpod 1 cicd 1