Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Ecosystem
pypi.org
Latest Release
0.20.2
5 days ago
Versions
85
Downloads
7,408,760 last month
Dependent Packages
46
Dependent Repos
5
    Loading...
    Readme
    Loading...
    Links
    Registry pypi.org
    Source Repository
    Docs Documentation
    JSON API View JSON
    CodeMeta codemeta.json
    Package Details
    PURL pkg:pypi/vllm
    spec
    License Apache-2.0
    First Release almost 3 years ago
    Last Synced about 11 hours ago
    Keywords
    amd cuda gpt inference inferentia llama llm llm-serving llmops mlops model-serving pytorch rocm tpu trainium transformer xpu
    Repository
    Stars 25,904 on GitHub
    Forks 3,780 on GitHub
    Docker Dependents 27
    Docker Downloads 16,137
    Commits 2550
    Committers 523
    Avg per Author 4.876
    DDS 0.828
    commits.ecosyste.ms
    repos.ecosyste.ms
    Rankings on pypi.org
    Overall Top 3.4%
    Downloads Top 1.5%
    Dependent packages Top 7.4%
    Dependent repos Top 6.8%
    Forks Top 1.6%
    Docker downloads Top 3.2%
    Funding
    https://github.com/sponsors/vllm-project
    https://opencollective.com/["vllm"]