proxy.golang.org : github.com/thxcode/llama-box

LM inference server implementation based on *.cpp.

Registry - Source - Documentation - JSON
purl: pkg:golang/github.com/thxcode/llama-box
Keywords: cpp , diffusion , gguf , openai-compatible-api , transformer
License: MIT
Latest release: about 2 months ago
First release: over 1 year ago
Stars: 252 on GitHub
Forks: 22 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 7 days ago

• Readme
• Versions 100
• Dependent Packages 0
• Maintainers 0