crates.io "llm" keyword
memra-engine 0.141.0 💰
From-scratch CUDA LLM inference engine for NVIDIA RTX 50-series (sm_120a) and Hopper (sm_90a) - c...89 versions - Latest release: 9 minutes ago - 1.95 thousand downloads total - 5 stars on GitHub - 1 maintainer
memra-lanes 0.141.0 💰
Serving-lane types, SLO admission policy, and engine-truth step stats for the memra inference engine89 versions - Latest release: 9 minutes ago - 1.95 thousand downloads total - 5 stars on GitHub - 1 maintainer
genai-prices 0.2.2 💰
Calculate the price of generative AI API calls3 versions - Latest release: about 19 hours ago - 1.7 thousand downloads total - 412 stars on GitHub - 1 maintainer
agents-aws 0.0.30 💰
AWS integrations for the Rust deep agents SDK.27 versions - Latest release: 10 months ago - 6.06 thousand downloads total - 7 stars on GitHub - 1 maintainer
agents-sdk 0.0.29 💰
High-performance Rust SDK for composing reusable AI agents with custom tools, sub-agents, and pro...25 versions - Latest release: 10 months ago - 5.76 thousand downloads total - 7 stars on GitHub - 1 maintainer
agents-runtime 0.0.30 💰
Async runtime orchestration for Rust deep agents.27 versions - Latest release: 10 months ago - 6.3 thousand downloads total - 7 stars on GitHub - 1 maintainer
agents-core 0.0.30 💰
Core traits, data models, and prompt primitives for building deep agents.28 versions - Latest release: 10 months ago - 6.79 thousand downloads total - 16 stars on GitHub - 1 maintainer
uteke-core 0.23.0
The Brain for Your AI — persistent memory and smart context management53 versions - Latest release: 6 days ago - 2.05 thousand downloads total - 274 stars on GitHub - 1 maintainer
uteke-server 0.23.0
HTTP server for uteke — persistent warm memory for AI agents52 versions - Latest release: 6 days ago - 889 downloads total - 274 stars on GitHub - 1 maintainer
uteke-mcp 0.23.0
MCP server for uteke — expose persistent memory to AI coding agents48 versions - Latest release: 6 days ago - 1.16 thousand downloads total - 274 stars on GitHub - 1 maintainer
uteke-cli 0.23.0
CLI for Uteke — persistent semantic memory for AI agents, offline-first, ~30ms recall26 versions - Latest release: 6 days ago - 406 downloads total - 274 stars on GitHub - 1 maintainer
zeptoclaw 0.9.2
Ultra-lightweight personal AI assistant26 versions - Latest release: 7 months ago - 789 downloads total - 651 stars on GitHub - 1 maintainer
llm_devices 0.0.3
llm_devices: Device management and build system for LLM inference3 versions - Latest release: almost 2 years ago - 3.85 thousand downloads total - 255 stars on GitHub - 1 maintainer
mrun 0.4.0
Local inference server for coding agents on Apple Silicon5 versions - Latest release: about 1 hour ago - 37 downloads total - 1 stars on GitHub - 1 maintainer
crabctl 0.0.25
CLI tool for managing a running crabllm gateway9 versions - Latest release: 3 months ago - 185 downloads total - 10 stars on GitHub - 1 maintainer
crabllm 0.0.25
High-performance LLM API gateway — binary16 versions - Latest release: 3 months ago - 343 downloads total - 10 stars on GitHub - 1 maintainer
crabllm-bench 0.0.25
Mock OpenAI backend for benchmarking crabllm18 versions - Latest release: 3 months ago - 371 downloads total - 10 stars on GitHub - 1 maintainer
crabllm-llamacpp 0.0.25
Managed llama.cpp server with Ollama registry support14 versions - Latest release: 3 months ago - 331 downloads total - 10 stars on GitHub - 1 maintainer
crabllm-provider 0.0.25
Provider dispatch for the crabllm LLM API gateway18 versions - Latest release: 3 months ago - 3.71 thousand downloads total - 10 stars on GitHub - 1 maintainer
crabllm-core 0.0.25
Core types for the crabllm LLM API gateway18 versions - Latest release: 3 months ago - 5.89 thousand downloads total - 10 stars on GitHub - 1 maintainer
crabllm-http 0.0.25
Outbound HTTP client (hyper or reqwest) for the crabllm workspace4 versions - Latest release: 3 months ago - 754 downloads total - 10 stars on GitHub - 1 maintainer
crabllm-sdk 0.0.25
Typed Rust client for the crabllm LLM API gateway4 versions - Latest release: 3 months ago - 432 downloads total - 10 stars on GitHub - 1 maintainer
crabllm-proxy 0.0.25
HTTP proxy server for the crabllm LLM API gateway17 versions - Latest release: 3 months ago - 531 downloads total - 10 stars on GitHub - 1 maintainer
ironmark 3.0.0
Fast Markdown to HTML parser written in Rust with WebAssembly bindings64 versions - Latest release: about 2 hours ago - 1.33 thousand downloads total - 3 stars on GitHub - 1 maintainer
firecrawl 2.21.8
Official Rust SDK for Firecrawl, the context API for AI agents: search, scrape, parse, crawl, map...41 versions - Latest release: 21 days ago - 19 thousand downloads total - 198,844 stars on GitHub - 2 maintainers
orichalcum 0.5.0
A type-safe, composable agent orchestration framework for building complex, multi-step workflows.12 versions - Latest release: 4 months ago - 2.31 thousand downloads total - 0 stars on GitHub - 1 maintainer
navree-ai 1.0.0
Navree AiModule: text, structured output and streaming from many model providers, with failover, ...1 version - Latest release: about 2 hours ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
tokenburn-core 0.3.14
Shared core logic for TokenBurn — log collectors, aggregation and reports for pi, Zed, Claude Cod...24 versions - Latest release: about 2 hours ago - 937 downloads total - 0 stars on GitHub - 1 maintainer
sglang-api-types 0.1.0
Protobuf messages, tonic gRPC client and server, and JSON serde for SGLang's sglang.api.v1 API1 version - Latest release: 4 days ago - 6 downloads total - 38,429 stars on GitHub - 1 maintainer
llmsim 0.7.0 💰
LLM Traffic Simulator - A lightweight, high-performance LLM API simulator11 versions - Latest release: about 3 hours ago - 87.4 thousand downloads total - 6 stars on GitHub - 1 maintainer
teeny-llm 0.2.1
Teenygrad is a high-performance, memory-safe Rust ML training and inference library. It targets d...6 versions - Latest release: about 3 hours ago - 102 downloads total - 10 stars on GitHub - 1 maintainer
sok-drivers 0.0.1
Tool-specific output drivers and pattern packs for sok1 version - Latest release: about 4 hours ago - 0 downloads total - 1 maintainer
sok 0.0.1
Shapes the output of every shell command your LLM agent runs: status, the lines that matter, a po...1 version - Latest release: about 4 hours ago - 0 downloads total - 1 maintainer
sok-exec 0.0.1
Process execution for sok: shell selection, merged capture, timeouts, process-tree kill1 version - Latest release: about 4 hours ago - 0 downloads total - 1 maintainer
sok-core 0.0.1
Core types and pure text processing for sok: response format, normalisation, token estimation1 version - Latest release: about 4 hours ago - 0 downloads total - 1 maintainer
modelshelf 0.2.0 💰
A shared local LLM model registry: discover, deduplicate, download, and update models across desk...2 versions - Latest release: 21 days ago - 80 downloads total - 1 stars on GitHub - 1 maintainer
modelshelf-cli 0.2.0 💰
Command-line interface for modelshelf, the shared local LLM model registry.2 versions - Latest release: 21 days ago - 30 downloads total - 1 stars on GitHub - 1 maintainer
chanto-core 0.1.15
The parts of the chanto agent that build for every target, WebAssembly included. Released with ch...7 versions - Latest release: 8 days ago - 137 downloads total - 3 stars on GitHub - 1 maintainer
chanto 0.1.15
A fast, lean coding agent for your terminal17 versions - Latest release: 8 days ago - 203 downloads total - 3 stars on GitHub - 1 maintainer
chanto-desktop 0.0.0
Name reserved for Chanto, a coding agent that checks its own work. Real releases coming soon.1 version - Latest release: 10 days ago - 10 downloads total - 3 stars on GitHub - 1 maintainer
chanto-sdk 0.0.0
Name reserved for Chanto, a coding agent that checks its own work. Real releases coming soon.1 version - Latest release: 10 days ago - 10 downloads total - 3 stars on GitHub - 1 maintainer
chanto-web 0.0.0
Name reserved for Chanto, a coding agent that checks its own work. Real releases coming soon.1 version - Latest release: 10 days ago - 10 downloads total - 3 stars on GitHub - 1 maintainer
datalium-strata 0.9.0-preview.2
The Datalium Strata engine: typed state graphs for AI agents with compile-time validation, stream...2 versions - Latest release: about 5 hours ago - 44 downloads total - 1 maintainer
datalium-strata-ai 0.9.0-preview.2
Model calls and agents for Datalium Strata: a chat-client trait, OpenAI-compatible and Anthropic ...2 versions - Latest release: about 5 hours ago - 15 downloads total - 1 maintainer
datalium-strata-host 0.9.0-preview.2
Driver loops, settings and a store health probe for hosting Datalium Strata in a service2 versions - Latest release: about 5 hours ago - 13 downloads total - 1 maintainer
kimetsu-agent 2.11.0
Transport-neutral agent runtime for kimetsu: tools, prompts, verify-loop, providers (claude_code,...28 versions - Latest release: about 5 hours ago - 908 downloads total - 15 stars on GitHub - 1 maintainer
datalium-strata-memory 0.9.0-preview.2
In-memory, SQLite, Postgres and Redis persistence adapters for Datalium Strata2 versions - Latest release: about 5 hours ago - 33 downloads total - 1 maintainer
datalium-strata-cloud 0.9.0-preview.2
The Strata Cloud checkpoint store, decisions client and decision worker for Datalium Strata2 versions - Latest release: about 5 hours ago - 11 downloads total - 1 maintainer
kimetsu-core 2.11.0
Shared core types (config, events, ids, paths, memory kinds) for the kimetsu agent runtime + brain.28 versions - Latest release: about 5 hours ago - 1.24 thousand downloads total - 15 stars on GitHub - 1 maintainer
kimetsu-brain 2.11.0
Project + user-scope memory, hybrid retrieval (lexical + cosine), ambient context, secret redacti...28 versions - Latest release: about 5 hours ago - 1.09 thousand downloads total - 15 stars on GitHub - 1 maintainer
kimetsu-remote 2.11.0
Server-hosted Kimetsu brain over HTTP MCP, keyed by repository.1 version - Latest release: about 5 hours ago - 0 downloads total - 15 stars on GitHub - 1 maintainer
kimetsu-chat 2.11.0
Interactive REPL chat client + MCP sidecar + cross-harness bridge for kimetsu. Installs into Clau...28 versions - Latest release: about 5 hours ago - 745 downloads total - 15 stars on GitHub - 1 maintainer
kimetsu-bus 2.11.0
ADR 0001 F2 memory bus: iroh transport, static roster, request_pack.1 version - Latest release: about 5 hours ago - 0 downloads total - 15 stars on GitHub - 1 maintainer
kimetsu-sdk 2.11.0
In-process Rust entry for the ADR 0001 store operations. Not @kimetsu-ai/sdk.1 version - Latest release: about 5 hours ago - 0 downloads total - 15 stars on GitHub - 1 maintainer
kimetsu-cli 2.11.0
Top-level `kimetsu` binary: chat client, MCP sidecar, bridge for Claude Code / Codex, brain admin...28 versions - Latest release: about 5 hours ago - 565 downloads total - 15 stars on GitHub - 1 maintainer
litellm 0.0.1 💰
Placeholder for the LiteLLM Rust SDK, currently under development1 version - Latest release: 2 months ago - 18 downloads total - 62,653 stars on GitHub - 1 maintainer
blitzagent 0.2.2 💰
multi api Ai-agent framework4 versions - Latest release: over 1 year ago - 2.57 thousand downloads total - 13 stars on GitHub - 1 maintainer
blitzdenk 0.2.4 💰
A minimal multi api auto-context project chat bot as tui6 versions - Latest release: over 1 year ago - 3.16 thousand downloads total - 13 stars on GitHub - 1 maintainer
sprawling 0.0.16
A local multi-agent harness for persistent agent teams: long-running project work, agent communic...9 versions - Latest release: about 5 hours ago - 88 downloads total - 108 stars on GitHub - 1 maintainer
praxo-core 0.4.0
Embeddable MIT-licensed agent framework for Rust: tools, policy, events, memory, context, middlew...5 versions - Latest release: about 5 hours ago - 57 downloads total - 12 stars on GitHub - 1 maintainer
llm-sdk 0.4.2
A simple SDK for OpenAI compatible API.6 versions - Latest release: almost 3 years ago - 7.95 thousand downloads total - 45 stars on GitHub - 1 maintainer
byob 0.1.0
byob (bring your own brain): a native desktop AI coworker for any OpenAI-compatible endpoint1 version - Latest release: about 6 hours ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
deciduous 1.1.0
Decision graph tooling for AI-assisted development. Track every goal, decision, and outcome. Surv...90 versions - Latest release: 17 days ago - 2.72 thousand downloads total - 161 stars on GitHub - 1 maintainer
rune-chain-retry 0.1.0
Retry wrapper for rune-chain Llm: exponential backoff on transient failures1 version - Latest release: 3 months ago - 12 downloads total - 0 stars on GitHub - 1 maintainer
superfluid-engine-ffi 0.1.11
Draft-7 Engine over the existing baseRT batch C API (migration phase 1: strangler, engine untouched)10 versions - Latest release: about 6 hours ago - 201 downloads total - 22 stars on GitHub - 1 maintainer
superfluid-adapter-basert 0.1.11
baseRT's native engine as a superfluid runtime: libbaseRT over its tick ABI (superfluid-engine-ff...10 versions - Latest release: about 6 hours ago - 161 downloads total - 22 stars on GitHub - 1 maintainer
superfluid-tokenizer-llamacpp 0.1.11
The llama.cpp runtime's tokenizer library: GGUF tokenization through the vocabulary-only load of ...10 versions - Latest release: about 6 hours ago - 99 downloads total - 22 stars on GitHub - 1 maintainer
superfluid-adapter-llamacpp 0.1.11
llama.cpp as a superfluid runtime: RuntimePrimitives over the libllama llama.cpp publishes, loade...10 versions - Latest release: about 6 hours ago - 160 downloads total - 22 stars on GitHub - 1 maintainer
superfluid-adapter-mlx 0.1.11
MLX as a superfluid runtime: RuntimePrimitives over mlx-lm through an embedded CPython, for the g...10 versions - Latest release: about 6 hours ago - 111 downloads total - 22 stars on GitHub - 1 maintainer
langfuse-rust-sdk-macros 0.10.1
The #[observe] attribute of langfuse-rust-sdk (use it through the `macros` feature of that crate)4 versions - Latest release: about 6 hours ago - 17 downloads total - 0 stars on GitHub - 1 maintainer
superfluid-linkf 0.1.11
Link F session layer: head-daemon and node-agent endpoints — epochs, leases, command idempotency,...12 versions - Latest release: about 6 hours ago - 194 downloads total - 22 stars on GitHub - 1 maintainer
superfluid-adapter-mock 0.1.11
The mock engine as a superfluid runtime: what the daemon's tests and `superfluid-workerd --engine...10 versions - Latest release: about 6 hours ago - 171 downloads total - 22 stars on GitHub - 1 maintainer
langfuse-rust-sdk 0.10.1
Rust SDK for the Langfuse LLM observability API12 versions - Latest release: about 6 hours ago - 96 downloads total - 0 stars on GitHub - 1 maintainer
superfluid 0.1.11
The superfluid daemon: durable session store (WAL, verbatim token spans, epochs), generation runt...10 versions - Latest release: about 6 hours ago - 114 downloads total - 22 stars on GitHub - 2 maintainers
llamaedge 0.0.7
A library for interacting with LlamaEdge API7 versions - Latest release: almost 2 years ago - 5.45 thousand downloads total - 1 stars on GitHub - 1 maintainer
opai-agents-openai 0.3.0
OpenAI and OpenAI-compatible model adapters (Chat Completions, Responses) for the Rust OpenAI Age...3 versions - Latest release: about 7 hours ago - 53 downloads total - 0 stars on GitHub - 1 maintainer
opai-agents-providers 0.2.0
Named provider presets (DeepSeek, Gemini, Groq, OpenRouter, Ollama, ...) and a capability matrix ...2 versions - Latest release: 14 days ago - 30 downloads total - 0 stars on GitHub - 1 maintainer
opai-agents-mcp 0.3.0
MCP client (stdio and streamable HTTP) for the Rust OpenAI Agents SDK3 versions - Latest release: about 7 hours ago - 27 downloads total - 0 stars on GitHub - 1 maintainer
opai-agents-tools 0.2.0
Ready-made tools for the Rust OpenAI Agents SDK: calculator, clock, web fetch, read-only files2 versions - Latest release: 14 days ago - 29 downloads total - 0 stars on GitHub - 1 maintainer
opai-agents 0.2.0
Rust port of the OpenAI Agents Python SDK (core loop, tools, handoffs, HITL, guardrails, structur...2 versions - Latest release: 14 days ago - 21 downloads total - 0 stars on GitHub - 1 maintainer
opai-agents-teams 0.3.0
Agent teams for the Rust OpenAI Agents SDK: a lead and long-lived teammates that work in parallel...3 versions - Latest release: about 7 hours ago - 25 downloads total - 0 stars on GitHub - 1 maintainer
opai-agents-guardrails 0.3.0
Ready-made guardrails for the Rust OpenAI Agents SDK: length, PII redaction, prompt-injection heu...3 versions - Latest release: about 8 hours ago - 28 downloads total - 0 stars on GitHub - 1 maintainer
opai-agents-macros 0.3.0
Proc-macros for opai-agents (function_tool, ToolMeta)3 versions - Latest release: about 8 hours ago - 37 downloads total - 0 stars on GitHub - 1 maintainer
opai-agents-core 0.3.0
Core of the Rust port of the OpenAI Agents Python SDK: agents, tools, handoffs, HITL, guardrails,...3 versions - Latest release: about 8 hours ago - 156 downloads total - 0 stars on GitHub - 1 maintainer
lavoisier 0.18.12
Lavoisier — a token-efficient CLI coding agent (Anthropic + xAI + Google Gemini), with prompt cac...37 versions - Latest release: about 7 hours ago - 661 downloads total - 0 stars on GitHub - 1 maintainer
bonsai-ninja-lang-kotlin 0.3.1
Kotlin language adapter.15 versions - Latest release: 2 months ago - 463 downloads total - 25 stars on GitHub - 1 maintainer
cortexdb-client 0.3.0
Typed gRPC client for CortexDB (AI memory + knowledge graph sidecar)4 versions - Latest release: about 8 hours ago - 61 downloads total - 457 stars on GitHub - 1 maintainer
muxer 0.6.2
Multi-objective bandit routing with drift detection23 versions - Latest release: 7 days ago - 19 thousand downloads total - 0 stars on GitHub - 1 maintainer
atman-macros 1.19.1
Tool binding macros for Atman hosts8 versions - Latest release: about 14 hours ago - 379 downloads total - 11 stars on GitHub - 1 maintainer
atman-rt 1.18.0
Embeddable Atman language virtual machine7 versions - Latest release: 11 days ago - 317 downloads total - 11 stars on GitHub - 1 maintainer
atman-runtime 1.18.0
Atman host runtime: executor, tool and provider dispatch, memory stores27 versions - Latest release: 11 days ago - 862 downloads total - 11 stars on GitHub - 1 maintainer
atman-daemon 1.18.0
atman headless daemon — Unix socket + HTTP SSE server for the atman AI coding agent27 versions - Latest release: 11 days ago - 582 downloads total - 11 stars on GitHub - 1 maintainer
atman-tui 1.19.1
atman TUI — ratatui-based terminal frontend for the atman AI coding agent runtime28 versions - Latest release: about 14 hours ago - 601 downloads total - 11 stars on GitHub - 1 maintainer
atman-dsl 1.13.2
atman flow DSL: parser, AST, pretty-printer20 versions - Latest release: about 2 months ago - 764 downloads total - 11 stars on GitHub - 1 maintainer
atman-proto 1.19.1
atman JSON-RPC 2.0 protocol types for the headless daemon28 versions - Latest release: about 14 hours ago - 735 downloads total - 11 stars on GitHub - 1 maintainer
atman-cli 1.19.1
atman command-line interface — AI coding agent runtime with a Turing-complete .at flow DSL27 versions - Latest release: about 14 hours ago - 430 downloads total - 11 stars on GitHub - 1 maintainer
vigil-redaction 0.5.0
Privacy filter for Vigil — hard fingerprint rules (13 kinds) + optional ONNX-backed PII scanner w...6 versions - Latest release: 4 months ago - 509 downloads total - 74 stars on GitHub - 1 maintainer
vigil-ui-protocol 0.5.0
IPC protocol types for Vigil desktop UI — Tauri command request/response schemas with capability ...6 versions - Latest release: 4 months ago - 265 downloads total - 74 stars on GitHub - 1 maintainer
vigil-firewall 0.5.0
Fail-closed effect firewall for Vigil — policy engine, approval queue, PII scanner, OAuth scope a...6 versions - Latest release: 4 months ago - 269 downloads total - 74 stars on GitHub - 1 maintainer
vigil-audit 0.5.0
Append-only audit ledger for Vigil with SQLite backend, SHA256 hash chain, and FTS5 search — tamp...6 versions - Latest release: 4 months ago - 447 downloads total - 74 stars on GitHub - 1 maintainer
Related Keywords
ai
2,398
rust
2,074
agent
1,385
mcp
1,055
cli
937
ai-agents
876
agents
708
openai
569
claude
392
anthropic
349
developer-tools
343
inference
323
claude-code
308
agentic-ai
299
rag
290
ollama
253
automation
250
ai-agent
245
tui
235
security
230
machine-learning
213
mcp-server
210
agent-framework
210
gemini
210
tools
207
memory
199
self-hosted
196
workflow
189
terminal
174
sdk
172
wasm
171
model-context-protocol
163
agentic
154
coding-agent
151
llmops
149
gguf
148
embeddings
148
codex
146
python
143
harness
140
orchestration
138
quantization
136
generative-ai
135
multi-agent
134
markdown
131
genai
124
runtime
124
knowledge-graph
122
proxy
121
framework
121
api
121
streaming
120
a2a
113
local-first
112
sandbox
109
langchain
109
cloud
109
agent-memory
105
autonomous-agents
105
async
103
serverless
102
gateway
98
yaml
98
chat
97
context-engineering
96
tool-calling
95
benchmarks
95
dag
95
typescript
94
saas
93
multi-tier
93
multi-tenancy
93
microservices
93
devops
92
cuda
90
graph
90
chatgpt
89
local-ai
86
llm-inference
86
llama
85
context
84
vector-search
84
large-language-model
82
observability
80
nlp
79
local-llm
78
distributed
77
agent-orchestration
77
database
76
gpu
76
workflow-engine
75
rust-crate
75
prompt
74
deep-learning
74
tree-sitter
74
parser
72
open-source
72
deterministic
72
tokio
71
ai-infrastructure
70