Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
Top 1.5% downloads on pypi.org
Top 7.4% dependent packages on pypi.org
Top 6.8% dependent repos on pypi.org
Top 1.6% forks on pypi.org
Top 3.2% docker downloads on pypi.org
pypi.org : vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Registry
-
Source
- Documentation
- JSON
purl: pkg:pypi/vllm
Keywords: amd, cuda, gpt, inference, inferentia, llama, llm, llm-serving, llmops, mlops, model-serving, pytorch, rocm, trainium, transformer
License: Apache-2.0
Latest release: 28 days ago
First release: 12 months ago
Dependent packages: 46
Dependent repositories: 5
Downloads: 408,227 last month
Stars: 17,633 on GitHub
Forks: 2,286 on GitHub
Docker dependents: 27
Docker downloads: 16,137
See more repository details: repos.ecosyste.ms
Last synced: about 17 hours ago
0.4.0.post1
Published: about 2 months agoRegistry - Documentation - Download sha256-ea4ced35b5166...