formulae.brew.sh "inference-server" keyword
rapid-mlx 0.15.7 💰
Fast local AI engine for Apple Silicon with an OpenAI-compatible API11 versions - Latest release: 16 days ago - 837 downloads last month - 4,040 stars on GitHub
shimmy 2.6.5 💰
Small local inference server with OpenAI-compatible GGUF endpoints17 versions - Latest release: 8 days ago - 26 downloads last month - 5,995 stars on GitHub
ramalama 0.24.0
Goal of RamaLama is to make working with AI boring34 versions - Latest release: about 1 month ago - 367 downloads last month - 2,214 stars on GitHub
Related Keywords
llamacpp
2
llm-inference
2
openai-compatible
2
local-ai
2
huggingface
1
huggingface-models
1
huggingface-transformers
1
llama
1
machine-learning
1
ollama-api
1
rust
1
rust-crate
1
transformers
1
webgpu
1
webgpu-shaders
1
ai
1
containers
1
cuda
1
hip
1
intel
1
llm
1
podman
1
vllm
1
anthropic-api
1
apple-silicon
1
claude-code
1
coding-agents
1
continuous-batching
1
llm-server
1
lm-studio-alternative
1
local-llm
1
macos
1
mcp
1
mlx
1
mlx-lm
1
ollama-alternative
1
omlx-alternative
1
speculative-decoding
1
tool-calling
1
api-server
1
command-line-tool
1
developer-tools
1
gguf
1