formulae.brew.sh "llamacpp" keyword
shimmy 2.6.5 💰
Small local inference server with OpenAI-compatible GGUF endpoints17 versions - Latest release: 8 days ago - 26 downloads last month - 5,995 stars on GitHub
tenere 0.11.3 💰
TUI interface for LLMs written in Rust2 versions - Latest release: about 1 year ago - 7 downloads last month - 685 stars on GitHub
ramalama 0.24.0
Goal of RamaLama is to make working with AI boring34 versions - Latest release: about 1 month ago - 367 downloads last month - 2,214 stars on GitHub
Related Keywords
rust
2
inference-server
2
llm
2
webgpu
1
webgpu-shaders
1
ai
1
containers
1
cuda
1
hip
1
intel
1
podman
1
vllm
1
chatgpt
1
cli
1
ollama
1
ratatui
1
tui
1
transformers
1
rust-crate
1
openai-compatible
1
ollama-api
1
machine-learning
1
local-ai
1
llm-inference
1
llama
1
huggingface-transformers
1
huggingface-models
1
huggingface
1
gguf
1
developer-tools
1
command-line-tool
1
api-server
1