`lmcpp`

Rust bindings for llama.cpp's server with managed toolchain, typed endpoints, and UDS/HTTP support

Ecosystem
crates.io

Latest Release
0.1.1
8 months ago

Versions
2

Downloads
824 total

llm_models 0.0.3

llm_models: Load and download LLM models, metadata, and tokenizers
3 versions - Latest release: 8 months ago - 4.49 thousand downloads total - 238 stars on GitHub - 1 maintainer

llm_client 0.0.7

llm_client: The easiest Rust interface for local LLMs
5 versions - Latest release: about 1 year ago - 5.49 thousand downloads total - 48 stars on GitHub - 1 maintainer

llm_interface 0.0.3

llm_interface: The backend for the llm_client crate
3 versions - Latest release: about 1 year ago - 3.41 thousand downloads total - 238 stars on GitHub - 1 maintainer

llm_devices 0.0.3

llm_devices: Device management and build system for LLM inference
3 versions - Latest release: about 1 year ago - 3.61 thousand downloads total - 240 stars on GitHub - 1 maintainer

llm_prompt 0.0.3

llm_prompt: Low Level Prompt System for API LLMs and local LLMs
3 versions - Latest release: about 1 year ago - 4.56 thousand downloads total - 238 stars on GitHub - 1 maintainer

Links

Registry	crates.io
Source	Repository
Docs	Documentation
JSON API	View JSON
CodeMeta	codemeta.json

Package Details

PURL	`pkg:cargo/lmcpp` spec
License	MIT
First Release	8 months ago
Last Synced	4 days ago

Keywords
ai cpp inference llama llm candle gguf rust

Repository

Stars	238 on GitHub
Forks	23 on GitHub

repos.ecosyste.ms

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Packages