pypi.org "llama-cpp" keyword
View the packages on the pypi.org package registry that are tagged with the "llama-cpp" keyword.
langport 0.3.11
A large language model serving platform.14 versions - Latest release: over 1 year ago - 25 downloads last month - 92 stars on GitHub - 1 maintainer
flashtts 0.1.7
A Fast TTS toolkit8 versions - Latest release: 6 months ago - 103 downloads last month - 491 stars on GitHub - 1 maintainer
sollol 0.9.66
Intelligent Load Balancer for Ollama Clusters - Adaptive Parallelism + VRAM-Aware GPU Routing + R...53 versions - Latest release: 4 days ago - 5.84 thousand downloads last month - 1 stars on GitHub - 1 maintainer
openai-agents-redis 0.1.0
Session management for OpenAI Agents SDK using Redis.2 versions - Latest release: 4 months ago - 1 thousand downloads last month - 14 stars on GitHub - 1 maintainer
grammarflow 0.1.1
Ensuring parsability of LLM responses in agent chains10 versions - Latest release: over 1 year ago - 42 downloads last month - 9 stars on GitHub - 1 maintainer
llama-server 0.2.2
LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.5 versions - Latest release: over 2 years ago - 195 downloads last month - 108 stars on GitHub - 1 maintainer
universal-intelligence 1.2.0 💰
Universal Intelligence11 versions - Latest release: 5 months ago - 32 downloads last month - 43 stars on GitHub - 1 maintainer
aikitx 1.0.0
A comprehensive GUI toolkit for Large Language Models (LLMs) with GGUF support, document processi...1 version - Latest release: 3 months ago - 22 downloads last month - 0 stars on GitHub - 1 maintainer
llama-cpp-cffi 0.4.44
Python binding for llama.cpp using cffi83 versions - Latest release: 7 months ago - 830 downloads last month - 3 stars on GitHub - 2 maintainers
vulkan-ilm 0.1.1
Pythonic LLM inference on legacy GPUs using Vulkan — GPU-accelerated local AI for AMD, Intel, and...2 versions - Latest release: 24 days ago - 24 stars on GitHub - 1 maintainer
patchpatrol 0.4.0
AI-powered commit review system for pre-commit hooks - Local (ONNX/llama.cpp) or cloud (Gemini) a...6 versions - Latest release: 21 days ago - 484 downloads last month - 0 stars on GitHub - 1 maintainer
optimum-benchmark 0.6.0
Optimum-Benchmark is a unified multi-backend utility for benchmarking Transformers, Timm, Diffuse...7 versions - Latest release: 3 months ago - 217 downloads last month - 315 stars on GitHub - 1 maintainer
tinyagi 0.0.2
TinyAGI is a modular AI agent framework controlled via JSON configuration.2 versions - Latest release: 12 months ago - 8 downloads last month - 4 stars on GitHub - 1 maintainer
Related Keywords
llm
6
ai
5
llama
5
machine-learning
4
python
4
transformers
3
ollama
3
inference
3
openai
3
artificial-intelligence
3
api
2
agents
2
llama.cpp
2
chatbot
2
onnx
2
gguf
2
intel
2
language-model
2
vllm
2
framework
1
benchmark
1
pre-commit-hook
1
pre-commit
1
modular
1
local
1
git
1
gemini
1
code-review
1
cloud
1
python-wrapper
1
open-source-llm
1
plugins
1
localllm
1
llm-inference
1
llama-cpp-python
1
legacy-gpus
1
task-automation
1
intel-gpu
1
fastai
1
amd-gpu
1
open-source
1
cuda-alternative
1
amd
1
ai-inference
1
gpu
1
local-ai
1
vulkan
1
cffi
1
llama-cpp-cffi
1
chatgpt
1
openvino
1
onnxruntime
1
pytorch
1
neural-compressor
1
tensorrt-llm
1
training
1
text-generation-inference
1
timm
1
sentence-transformers
1
quantization
1
py-txi
1
pruning
1
peft
1
optimization
1
onnx runtime
1
agi
1
neural compressor
1
llm-swarm
1
ipu
1
cli
1
ipex
1
hpu
1
habana
1
developer-tools
1
extensible
1
graphcore
1
gptqmodel
1
flash-attn
1
diffusers
1
deepspeed
1
codecarbon
1
bitsandbytes
1
distributed-inference
1
gpu-monitoring
1
http2
1
hybrid-routing
1
inference-optimization
1
load-balancer
1
model-serving
1
multi-node
1
performance
1
ray
1
rpc
1
streaming
1
multiagent-systems
1
openai-agents-sdk
1
redis
1
agent
1
chatgpt-api
1
fauxpilot
1