pypi.org : lazyllm-lmdeploy
A toolset for compressing, deploying and serving LLM
Registry
- Documentation
- JSON
purl: pkg:pypi/lazyllm-lmdeploy
Keywords:
codellama
, cuda-kernels
, deepspeed
, fastertransformer
, internlm
, llama
, llama2
, llama3
, llm
, llm-inference
, turbomind
License: Apache-2.0
Latest release: 7 months ago
First release: 7 months ago
Downloads: 26 last month
Stars: 6,298 on GitHub
Forks: 538 on GitHub
Total Commits: 1045
Committers: 86
Average commits per author: 12.151
Development Distribution Score (DDS): 0.809
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Last synced: 4 days ago