proxy.golang.org : github.com/ModelTC/lightllm
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Registry
-
Source
- Documentation
- JSON
- codemeta.json
purl: pkg:golang/github.com/%21model%21t%21c/lightllm
Keywords:
deep-learning
, gpt
, llama
, llm
, model-serving
, nlp
, openai-triton
License: Apache-2.0
Latest release: 4 months ago
First release: 11 months ago
Stars: 3,757 on GitHub
Forks: 284 on GitHub
Total Commits: 310
Committers: 35
Average commits per author: 8.857
Development Distribution Score (DDS): 0.594
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Last synced: 7 days ago