Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

crates.io "llama-cpp" keyword

llama_cpp_rs 0.3.0 💰
Rust bindings for LLAMA.CPP inference
5 versions - Latest release: over 2 years ago - 13.3 thousand downloads total - 316 stars on GitHub - 1 maintainer
rs-llama-cpp 0.1.67
Automated Rust bindings generation for LLaMA.cpp
62 versions - Latest release: over 2 years ago - 88.7 thousand downloads total - 4 stars on GitHub - 1 maintainer
deepthought 0.1.11
Functional wrapper around Llama.cpp with Rust Dynamic datatypes and Vector store support for crea...
12 versions - Latest release: about 2 months ago - 164 downloads total - 1 maintainer
ggml-quants 0.1.0
GGml defined quantized data types and their quant/dequant algorithm
2 versions - Latest release: 9 months ago - 90.5 thousand downloads total - 9 stars on GitHub - 1 maintainer
ggus 0.5.1
GGUF in Rust🦀
8 versions - Latest release: 9 months ago - 86.8 thousand downloads total - 2 stars on GitHub - 1 maintainer
gguf-utils 0.4.1
Utilities for handling gguf files
10 versions - Latest release: 8 months ago - 6.34 thousand downloads total - 10 stars on GitHub - 1 maintainer
llm_client 0.0.7
llm_client: The easiest Rust interface for local LLMs
5 versions - Latest release: about 1 year ago - 5.46 thousand downloads total - 48 stars on GitHub - 1 maintainer
Related Keywords
gguf 4 ai 3 ggml 3 llama 2 rust 2 llm 2 candle 1 anthropic 1 openai 1 vector 1 vecstore 1 rag 1 embedding 1 bindings 1 model 1 ffi 1 crates-io 1 cpp 1 machine-learning 1 inference 1 api-bindings 1