pypi.org : vllm-cpm
A high-throughput and memory-efficient inference and serving engine for LLMs
Registry
-
Source
- Documentation
- JSON
purl: pkg:pypi/vllm-cpm
Keywords:
cloud-computing
, cloud-management
, cost-management
, cost-optimization
, data-science
, deep-learning
, distributed-training
, finops
, gpu
, hyperparameter-tuning
, job-queue
, job-scheduler
, llm-serving
, llm-training
, machine-learning
, ml-infrastructure
, ml-platform
, multicloud
, spot-instances
, tpu
License: Apache-2.0
Latest release: about 1 year ago
First release: about 1 year ago
Downloads: 22 last month
Stars: 7,693 on GitHub
Forks: 613 on GitHub
Total Commits: 1513
Committers: 73
Average commits per author: 20.726
Development Distribution Score (DDS): 0.656
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Last synced: 18 minutes ago