proxy.golang.org : github.com/janhq/nitro
Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM). Powers 👋 Jan
Registry
-
Source
- Documentation
- JSON
- codemeta.json
purl: pkg:golang/github.com/janhq/nitro
Keywords:
accelerated
, ai
, cuda
, gguf
, inference-engine
, llama
, llama2
, llamacpp
, llm
, llms
, openai-api
, stable-diffusion
, tensorrt-llm
License: AGPL-3.0
Latest release: 5 months ago
First release: over 1 year ago
Stars: 1,573 on GitHub
Forks: 75 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 15 days ago