crates.io "llm" keyword
mobius-cli 0.16.10
The terminal client for a möbius gateway103 versions - Latest release: 4 minutes ago - 1.49 thousand downloads total - 1 stars on GitHub - 1 maintainer
mobius-gateway 0.16.10
Headless authenticated gateway for möbius frontends110 versions - Latest release: 5 minutes ago - 2.05 thousand downloads total - 1 stars on GitHub - 1 maintainer
infra-compass-db 0.0.8
Parse and manage the NREL's INFRA-COMPASS data5 versions - Latest release: over 1 year ago - 2.99 thousand downloads total - 17 stars on GitHub - 2 maintainers
infra-compass-cli 0.0.6
Command line application to manage and query NREL's INFRA-COMPASS data2 versions - Latest release: over 1 year ago - 1.12 thousand downloads total - 17 stars on GitHub - 3 maintainers
frink-inference 0.49.0
Pure-Rust GGUF / MoE inference engine: mmap loaders, quantized CPU + Metal + CUDA kernels24 versions - Latest release: 11 days ago - 324 downloads total - 61 stars on GitHub - 1 maintainer
frink-metal 0.49.0
Apple Metal kernels for the Frink inference engine24 versions - Latest release: 11 days ago - 641 downloads total - 61 stars on GitHub - 1 maintainer
frink-api 0.49.0
Shared route constants and wire DTOs for the Frink HTTP surface and its clients24 versions - Latest release: 11 days ago - 502 downloads total - 61 stars on GitHub - 1 maintainer
frink-safetensors 0.49.0
SafeTensors mmap loader for the Frink inference engine24 versions - Latest release: 11 days ago - 610 downloads total - 61 stars on GitHub - 1 maintainer
frink-cli 0.49.0
llama.cpp-style CLI for the Frink inference engine24 versions - Latest release: 11 days ago - 326 downloads total - 61 stars on GitHub - 1 maintainer
frink-core 0.49.0
Core tensor ops, RoPE, GQA, and KV cache for Frink24 versions - Latest release: 11 days ago - 673 downloads total - 61 stars on GitHub - 1 maintainer
frink-models 0.49.0
Model loaders and decoder stacks for the Frink inference engine24 versions - Latest release: 11 days ago - 564 downloads total - 61 stars on GitHub - 1 maintainer
frink-moe 0.49.0
Mixture-of-Experts routing and expert dispatch for Frink24 versions - Latest release: 11 days ago - 616 downloads total - 61 stars on GitHub - 1 maintainer
frink-quant 0.49.0
Quantized weight formats and fused dequant kernels for Frink24 versions - Latest release: 11 days ago - 775 downloads total - 61 stars on GitHub - 1 maintainer
frink-gguf 0.49.0
GGUF mmap loader for the Frink inference engine24 versions - Latest release: 11 days ago - 712 downloads total - 61 stars on GitHub - 1 maintainer
frink-server 0.49.0
OpenAI-compatible HTTP server for the Frink inference engine24 versions - Latest release: 11 days ago - 429 downloads total - 61 stars on GitHub - 1 maintainer
frink-cuda 0.49.0
CUDA/NVRTC kernels for the Frink inference engine24 versions - Latest release: 11 days ago - 715 downloads total - 61 stars on GitHub - 1 maintainer
frink-vulkan 0.49.0
Vulkan/SPIR-V beachhead for the Frink inference engine (GO/NO-GO slice, not a backend)24 versions - Latest release: 11 days ago - 326 downloads total - 61 stars on GitHub - 1 maintainer
mistral_api_client 0.1.0
Unofficial Rust client for Mistral AI API1 version - Latest release: over 1 year ago - 735 downloads total - 0 stars on GitHub - 1 maintainer
mistral_client 0.1.0 removed
Unofficial Rust client for Mistral AI API1 version - Latest release: over 1 year ago - 0 downloads total - 0 stars on GitHub
attestr 0.5.0
Promise-Theory verification: assess a turn's output against declared promises → findings + trust ...7 versions - Latest release: 27 days ago - 1.36 thousand downloads total - 0 stars on GitHub - 1 maintainer
mcprs 0.1.0
Model Context Protocol para Rust - Uma biblioteca unificada para comunicação com diferentes LLMs ...1 version - Latest release: over 1 year ago - 694 downloads total - 1 stars on GitHub - 1 maintainer
inferlab-protocol 0.16.0
Wire types for the Inferlab framework-integration protocol: strict, versioned one-shot JSON adapt...34 versions - Latest release: about 1 hour ago - 1.01 thousand downloads total - 3 stars on GitHub - 1 maintainer
inferlab-runtime 0.16.0
Framework-neutral runtime lifecycle mechanics for the InferLab product.26 versions - Latest release: about 1 hour ago - 768 downloads total - 3 stars on GitHub - 1 maintainer
mnemoria 0.3.5 💰
Persistent, git-friendly memory storage for AI agents with hybrid semantic + full-text search9 versions - Latest release: 7 months ago - 393 downloads total - 15 stars on GitHub - 1 maintainer
rr-rtk 0.45.0-rr.1
Rust Token Killer - High-performance CLI proxy to minimize LLM token consumption (personal fork o...3 versions - Latest release: about 1 month ago - 382 downloads total - 0 stars on GitHub - 1 maintainer
airframe-observe 0.1.2 💰
FSE-based inference observation layer for Airframe. Selector-first, single-pass capture of layer ...3 versions - Latest release: 2 months ago - 1.51 thousand downloads total - 20 stars on GitHub - 1 maintainer
airframe 0.4.3 💰
Pure-Rust WebGPU inference engine for GGUF models. No C++ toolchain, no llama.cpp. Runs on NVIDIA...17 versions - Latest release: about 1 month ago - 3.02 thousand downloads total - 20 stars on GitHub - 1 maintainer
ramarivera-rtk
Rust Token Killer - High-performance CLI proxy to minimize LLM token consumption (personal fork o...2 versions - Latest release: about 2 hours ago - 33 downloads total - 0 stars on GitHub - 1 maintainer
libfse 0.1.3 💰
Fused Semantic Execution: fail-closed policy engine with O(1)-in-rule-count scanning, zero-alloca...4 versions - Latest release: 4 months ago - 2.66 thousand downloads total - 20 stars on GitHub - 1 maintainer
shimmytok 0.8.4 💰
Pure Rust tokenizer for GGUF models with llama.cpp compatibility (SentencePiece + BPE + WPM + UGM...14 versions - Latest release: 13 days ago - 8.95 thousand downloads total - 26 stars on GitHub - 1 maintainer
shimmy 2.6.4 💰
Lightweight Ollama-compatible inference server with native SafeTensors support. No Python depende...34 versions - Latest release: about 1 month ago - 13.4 thousand downloads total - 5,914 stars on GitHub - 1 maintainer
sovran-mcp 0.3.6
A synchronous Rust client for the Model Context Protocol (MCP)2 versions - Latest release: over 1 year ago - 1.72 thousand downloads total - 6 stars on GitHub - 1 maintainer
pi-agent 1.0.0
Agent runtime with tool calling (Rust port of @earendil-works/pi-agent-core). Streaming agent loo...1 version - Latest release: 5 months ago - 254 downloads total - 112,027 stars on GitHub - 1 maintainer
pi-coding-agent 1.0.0
Interactive coding agent CLI (Rust port of @earendil-works/pi-coding-agent). Streaming REPL, sess...1 version - Latest release: 5 months ago - 89 downloads total - 112,027 stars on GitHub - 1 maintainer
pi-ai 1.0.0
Unified multi-provider LLM API (Rust port of @earendil-works/pi-ai). Streams from Anthropic, Open...1 version - Latest release: 5 months ago - 300 downloads total - 112,027 stars on GitHub - 1 maintainer
secretary 0.4.42
Transform natural language into structured data using large language models (LLMs) with powerful ...30 versions - Latest release: about 1 year ago - 12.3 thousand downloads total - 5 stars on GitHub - 1 maintainer
aprender-quant 0.70.1
K-quantization formats (Q4_K, Q5_K, Q6_K) for GGUF/APR model weights31 versions - Latest release: about 2 hours ago - 40.1 thousand downloads total - 25 stars on GitHub - 1 maintainer
volition-core 0.2.0
Core library for the Volition AI agent6 versions - Latest release: over 1 year ago - 3.96 thousand downloads total - 2 stars on GitHub - 1 maintainer
volition-cli 0.2.6
An AI-powered software engineering assistant (CLI frontend)8 versions - Latest release: over 1 year ago - 4.6 thousand downloads total - 2 stars on GitHub - 1 maintainer
lavoisier 0.18.8
Lavoisier — a token-efficient CLI coding agent (Anthropic + xAI + Google Gemini), with prompt cac...33 versions - Latest release: about 20 hours ago - 597 downloads total - 0 stars on GitHub - 1 maintainer
files-to-prompt 1.0.4
Concatenates a directory full of files into a single prompt for use with LLMs13 versions - Latest release: 12 months ago - 8.01 thousand downloads total - 9 stars on GitHub - 1 maintainer
hex-cli 0.1.1
hex: a thin, deterministic control plane that runs agent CLIs (Claude Code, Codex, Pi, opencode) ...2 versions - Latest release: about 19 hours ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
everruns-llmsim 0.37.0
Deterministic in-process LLM simulation for Everruns agents and runtimes23 versions - Latest release: about 3 hours ago - 3.07 thousand downloads total - 51 stars on GitHub - 1 maintainer
clawlog 0.1.0
Log every prompt and response that is sent in-between you and your LLM of choice.1 version - Latest release: about 20 hours ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
bintensors 0.1.1
Bintensors is a high-performance binary tensor serialization format designed to be faster elimina...6 versions - Latest release: over 1 year ago - 3.76 thousand downloads total - 4 stars on GitHub - 1 maintainer
tru 0.2.5 💰
TOON reference implementation in Rust (JSON <-> TOON)7 versions - Latest release: about 3 hours ago - 29.5 thousand downloads total - 28 stars on GitHub - 1 maintainer
kanban-mcp 0.11.0
Model Context Protocol server for the kanban project management tool21 versions - Latest release: about 3 hours ago - 418 downloads total - 169 stars on GitHub - 1 maintainer
everruns-contracts 0.37.0
Shared runtime, provider, capability, and model profile contracts for Everruns1 version - Latest release: about 4 hours ago - 0 downloads total - 51 stars on GitHub - 1 maintainer
jawe-cuvs-sys-iv 25.4.0
Low-level rust bindings to libcuvs1 version - Latest release: over 1 year ago - 923 downloads total - 857 stars on GitHub - 1 maintainer
jawe-cuvs-iv 25.4.0
RAPIDS vector search library1 version - Latest release: over 1 year ago - 722 downloads total - 857 stars on GitHub - 1 maintainer
mcp-server-gdb 0.2.3
A GDB/MI protocol server based on the MCP protocol, providing remote application debugging capabi...2 versions - Latest release: over 1 year ago - 1.34 thousand downloads total - 50 stars on GitHub - 1 maintainer
everruns-macros 0.37.0
Procedural macros for the Everruns agentic framework (re-exported by `everruns`)19 versions - Latest release: about 4 hours ago - 492 downloads total - 51 stars on GitHub - 1 maintainer
everruns-serve-build 0.37.0
build.rs helper for serve (experimental): embeds agent/**/*.md and serve.toml7 versions - Latest release: about 4 hours ago - 51 downloads total - 51 stars on GitHub - 1 maintainer
fono 0.18.1 💰
Talk to your computer: an open-source, complete voice-AI stack (STT, TTS, LLM, wake word, speaker...12 versions - Latest release: about 2 months ago - 270 downloads total - 22 stars on GitHub - 1 maintainer
vex-search-mcp 1.27.2
MCP (Model Context Protocol) stdio server exposing the vex code-search CLI to AI agents1 version - Latest release: about 4 hours ago - 0 downloads total - 11 stars on GitHub - 1 maintainer
vex-search 1.27.2
Fast hybrid structural + semantic code search CLI (tree-sitter index, call graph, ONNX embeddings...1 version - Latest release: about 4 hours ago - 0 downloads total - 11 stars on GitHub - 1 maintainer
smokesignal 0.1.0
The draft/verify handshake for speculative decoding across heterogeneous accelerators: a small re...1 version - Latest release: about 4 hours ago - 0 downloads total - 1 maintainer
vllm-proto 0.4.0 💰
Protobuf messages and gRPC bindings for the vLLM Rust frontend5 versions - Latest release: 4 days ago - 38.9 thousand downloads total - 92,986 stars on GitHub - 1 maintainer
mem7-dedup 0.3.3
Memory deduplication logic for the mem7 memory engine10 versions - Latest release: 6 months ago - 437 downloads total - 40 stars on GitHub - 1 maintainer
mem7-store 0.3.3
The core memory engine orchestrator for mem75 versions - Latest release: 6 months ago - 252 downloads total - 40 stars on GitHub - 1 maintainer
mem7-config 0.3.3
Configuration types for the mem7 memory engine10 versions - Latest release: 6 months ago - 1.17 thousand downloads total - 40 stars on GitHub - 1 maintainer
mem7-llm 0.3.3
LLM client abstraction for the mem7 memory engine10 versions - Latest release: 6 months ago - 596 downloads total - 40 stars on GitHub - 1 maintainer
mem7-graph 0.3.3
Graph store trait and providers for mem72 versions - Latest release: 6 months ago - 279 downloads total - 40 stars on GitHub - 1 maintainer
mem7-telemetry 0.3.3
Optional OpenTelemetry integration for mem72 versions - Latest release: 6 months ago - 129 downloads total - 40 stars on GitHub - 1 maintainer
mem7-core 0.3.3
Core types and ID generation for the mem7 memory engine10 versions - Latest release: 6 months ago - 1.03 thousand downloads total - 40 stars on GitHub - 1 maintainer
mem7-error 0.3.3
Error types for the mem7 memory engine10 versions - Latest release: 6 months ago - 1.17 thousand downloads total - 40 stars on GitHub - 1 maintainer
mem7-embedding 0.3.3
Embedding client abstraction for the mem7 memory engine10 versions - Latest release: 6 months ago - 436 downloads total - 40 stars on GitHub - 1 maintainer
mem7-vector 0.3.3
Vector index implementations for the mem7 memory engine10 versions - Latest release: 6 months ago - 519 downloads total - 40 stars on GitHub - 1 maintainer
mem7-history 0.3.3
SQLite-backed audit history for the mem7 memory engine10 versions - Latest release: 6 months ago - 440 downloads total - 40 stars on GitHub - 1 maintainer
mem7 0.3.3
LLM-powered long-term memory engine — Rust core with Python bindings5 versions - Latest release: 6 months ago - 149 downloads total - 40 stars on GitHub - 1 maintainer
jawe-cuvs-sys-ii 25.4.0
Low-level rust bindings to libcuvs1 version - Latest release: over 1 year ago - 722 downloads total - 781 stars on GitHub - 1 maintainer
jawe-cuvs-iii 25.4.0
RAPIDS vector search library1 version - Latest release: over 1 year ago - 730 downloads total - 743 stars on GitHub - 1 maintainer
jawe-cuvs-sys-iii 25.4.0
Low-level rust bindings to libcuvs1 version - Latest release: over 1 year ago - 946 downloads total - 727 stars on GitHub - 1 maintainer
ri-esp-llm 0.1.1
no_std embedded inference primitives: int4 packing, KV cache, RNN helpers, sampling, compressed a...2 versions - Latest release: 3 months ago - 42 downloads total - 0 stars on GitHub - 1 maintainer
pluck-core 0.6.0
Core indexing, AST chunking, BM25 search, and incremental reindex for pluck — the fast, token-fri...6 versions - Latest release: 4 months ago - 246 downloads total - 39 stars on GitHub - 1 maintainer
aic 0.2.0
AI-powered commit message generation CLI tool5 versions - Latest release: over 1 year ago - 3.65 thousand downloads total - 7 stars on GitHub - 1 maintainer
mesh-llm-sdk 0.77.0 💰
Rust SDK facade for Mesh LLM clients and embedded serving3 versions - Latest release: about 6 hours ago - 30 downloads total - 3,462 stars on GitHub - 1 maintainer
flow-like-wasm-sdk-macros 0.3.7 💰
Proc macros for the Flow-Like WASM SDK10 versions - Latest release: 4 months ago - 8.38 thousand downloads total - 957 stars on GitHub - 1 maintainer
skippy-server 0.77.0 💰
Embedded Skippy staged runtime server3 versions - Latest release: about 6 hours ago - 66 downloads total - 3,462 stars on GitHub - 1 maintainer
mesh-native-serving-plugin-host 0.77.0 💰
Deadline-safe native serving-plugin loader for Mesh Skippy3 versions - Latest release: about 6 hours ago - 60 downloads total - 3,462 stars on GitHub - 1 maintainer
tui-test-rs 0.1.0
In-process terminal automation, inspection, assertions, and recording7 versions - Latest release: about 6 hours ago - 933 downloads total - 274 stars on GitHub - 1 maintainer
everruns-core 0.36.0
Transport-neutral agent execution contracts for Everruns63 versions - Latest release: about 7 hours ago - 10.9 thousand downloads total - 51 stars on GitHub - 1 maintainer
helmsman 0.2.0
Adaptive instruction server3 versions - Latest release: 7 months ago - 75 downloads total - 23 stars on GitHub - 1 maintainer
pharia-skill 0.6.1
SDK for building Skills that run within Pharia Kernel.1 version - Latest release: over 1 year ago - 987 downloads total - 3 stars on GitHub - 1 maintainer
pharia-skill-macros 0.6.1
Procedural macros for use within the `pharia-skill` crate.1 version - Latest release: over 1 year ago - 1.19 thousand downloads total - 3 stars on GitHub - 1 maintainer
pharia-skill-test 0.6.1
Test helpers for testing Pharia Kernel skill components locally.1 version - Latest release: over 1 year ago - 751 downloads total - 3 stars on GitHub - 1 maintainer
cortiq-net 0.8.9
Network pipeline-split for CMF: the worker wire protocol and the coordinator that drives layer sp...59 versions - Latest release: about 7 hours ago - 1.63 thousand downloads total - 27 stars on GitHub - 1 maintainer
cortiq-server 0.8.9
OpenAI-compatible HTTP serving for CMF models, built on the cortiq inference engine.139 versions - Latest release: about 7 hours ago - 3.28 thousand downloads total - 27 stars on GitHub - 1 maintainer
aichat 0.30.0
All-in-one LLM CLI Tool31 versions - Latest release: about 1 year ago - 71.5 thousand downloads total - 10,473 stars on GitHub - 1 maintainer
thinkery-leanctx-sdk 1.1.1
SDK for embedding LeanCTX context control in Rust applications2 versions - Latest release: about 17 hours ago - 21 downloads total - 3 stars on GitHub - 1 maintainer
quat_llm 0.1.0
A high-performance, lightweight 2-bit quantized LLM inference engine in Rust1 version - Latest release: about 8 hours ago - 0 downloads total - 1 maintainer
llm-chain-llama-sys 0.13.0
A library with bindings based on bindgen for LLaMA.cpp26 versions - Latest release: almost 3 years ago - 1 dependent package - 2 dependent repositories - 38.8 thousand downloads total - 1,602 stars on GitHub - 1 maintainer
llm-chain-llama 0.13.0
A library implementing `llm-chains` for LLamA. Chains can be use to apply the model series to com...26 versions - Latest release: almost 3 years ago - 1 dependent repositories - 32.1 thousand downloads total - 1,602 stars on GitHub - 1 maintainer
llm-chain-local 0.12.3
Use `llm-chain` with a local [`llm`](https://github.com/rustformers/llm) backend.9 versions - Latest release: over 3 years ago - 11.6 thousand downloads total - 1,602 stars on GitHub - 1 maintainer
llm-chain-macros 0.13.0
Set of macros for use with llm-chain2 versions - Latest release: almost 3 years ago - 2.73 thousand downloads total - 1,602 stars on GitHub - 1 maintainer
llm-chain-tools 0.4.0
A library for providing Large Language Models with tools (also known as 'actions') that they can ...5 versions - Latest release: over 3 years ago - 6.29 thousand downloads total - 1,602 stars on GitHub - 1 maintainer
llm-chain-openai-compatible
A library implementing `llm-chains` for OpenAI's models. Chains can be use to apply the model ser...1 version - Latest release: about 8 hours ago - 1.28 thousand downloads total - 1,602 stars on GitHub - 1 maintainer
llm-chain-qdrant 0.13.0
For using Qdrant with llm-chain9 versions - Latest release: almost 3 years ago - 11.3 thousand downloads total - 1,602 stars on GitHub - 1 maintainer
Top 7.3% on crates.io
30 versions - Latest release: almost 3 years ago - 11 dependent packages - 10 dependent repositories - 98.2 thousand downloads total - 1,602 stars on GitHub - 1 maintainer
llm-chain 0.13.0
A library for running chains of LLMs (such as ChatGPT) in series to complete complex tasks, such ...30 versions - Latest release: almost 3 years ago - 11 dependent packages - 10 dependent repositories - 98.2 thousand downloads total - 1,602 stars on GitHub - 1 maintainer
llm-chain-openai 0.13.0
A library implementing `llm-chains` for OpenAI's models. Chains can be use to apply the model ser...26 versions - Latest release: almost 3 years ago - 1 dependent package - 4 dependent repositories - 75 thousand downloads total - 1,602 stars on GitHub - 1 maintainer
Related Keywords
ai
2,528
rust
1,863
agent
1,437
cli
932
mcp
928
ai-agents
596
openai
591
agents
590
anthropic
374
ai-agent
353
claude
351
inference
309
rag
305
agentic-ai
291
security
271
agent-framework
263
developer-tools
253
memory
243
tools
216
tui
213
gemini
192
claude-code
187
machine-learning
186
wasm
185
ollama
184
coding-agent
171
multi-agent
165
sdk
165
workflow
157
langchain
157
automation
148
genai
146
terminal
141
serverless
136
proxy
135
benchmarks
133
cloud
133
orchestration
132
microservices
130
multi-tenancy
130
multi-tier
130
saas
130
model-context-protocol
126
sandbox
124
framework
120
distributed
118
runtime
117
agentic
116
api
115
harness
114
python
114
a2a
112
async
109
context
109
gguf
108
mcp-server
106
autonomous-agents
106
observability
105
gateway
105
middleware
104
markdown
100
embeddings
100
event-sourcing
99
monorepo
99
agent-memory
98
codex
95
cuda
95
knowledge-graph
92
modkit
92
account-management
92
xaas
92
local-first
91
streaming
89
quantization
89
protocol
87
agent-runtime
83
constructorfabric
83
cf-gears
83
prompt
79
x402
79
graph
78
generative-ai
78
sqlite
78
langgraph
77
llmops
77
skills
76
compiler
75
context-engineering
74
tokio
74
agent-os
74
tree-sitter
73
tool-calling
73
vector-search
71
tokens
71
payments
71
gpu
69
trust-scoring
69
homeostatic-control
69
ml
68
chatgpt
68