Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
Top 1.5% downloads on pypi.org
Top 7.4% dependent packages on pypi.org
Top 6.8% dependent repos on pypi.org
Top 1.6% forks on pypi.org
Top 3.2% docker downloads on pypi.org
pypi.org : vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Registry
-
Source
- Documentation
- JSON
purl: pkg:pypi/vllm
Keywords: amd, cuda, gpt, inference, inferentia, llama, llm, llm-serving, llmops, mlops, model-serving, pytorch, rocm, trainium, transformer
License: Apache-2.0
Latest release: 13 days ago
First release: 11 months ago
Dependent packages: 46
Dependent repositories: 5
Downloads: 519,804 last month
Stars: 17,633 on GitHub
Forks: 2,286 on GitHub
Docker dependents: 27
Docker downloads: 16,137
See more repository details: repos.ecosyste.ms
Last synced: 2 days ago