crates.io "inference" keyword
View the packages on the crates.io package registry that are tagged with the "inference" keyword.
tree-sitter-inference 0.0.33
Inference grammar for tree-sitter33 versions - Latest release: 2 months ago - 24.3 thousand downloads total - 1 maintainer
llama_cpp_rs 0.3.0 💰
Rust bindings for LLAMA.CPP inference5 versions - Latest release: almost 2 years ago - 9.57 thousand downloads total - 316 stars on GitHub - 1 maintainer
inference-gateway-sdk 0.11.0
Rust SDK for interacting with various language models through the Inference Gateway38 versions - Latest release: about 20 hours ago - 19.4 thousand downloads total - 2 stars on GitHub - 1 maintainer
cervo-runtime 0.8.0
Multi-model multi-agent RL runtime for games.10 versions - Latest release: about 2 months ago - 1 dependent package - 1 dependent repositories - 51.6 thousand downloads total - 43 stars on GitHub - 1 maintainer
cervo-asset 0.8.0
A unified asset type for Cervo using ONNX or NNEF models.12 versions - Latest release: about 2 months ago - 2 dependent packages - 1 dependent repositories - 56.3 thousand downloads total - 43 stars on GitHub - 1 maintainer
cervo-core 0.8.0
High level APIs for RL in games.12 versions - Latest release: about 2 months ago - 5 dependent packages - 1 dependent repositories - 57.9 thousand downloads total - 43 stars on GitHub - 1 maintainer
cervo-onnx 0.8.0
Extends cervo with ONNX support from tract-onnx.12 versions - Latest release: about 2 months ago - 2 dependent packages - 1 dependent repositories - 56.9 thousand downloads total - 43 stars on GitHub - 1 maintainer
cervo 0.8.0
High level APIs for RL in games.12 versions - Latest release: about 2 months ago - 1 dependent package - 1 dependent repositories - 14.4 thousand downloads total - 43 stars on GitHub - 1 maintainer
cervo-cli 0.8.0
High level APIs for RL in games.8 versions - Latest release: about 2 months ago - 6.7 thousand downloads total - 43 stars on GitHub - 1 maintainer
cervo-nnef 0.8.0
Extends cervo with nnef support from tract-nnef.12 versions - Latest release: about 2 months ago - 2 dependent packages - 1 dependent repositories - 56.9 thousand downloads total - 43 stars on GitHub - 1 maintainer
enfer 0.1.0
Feakin is a architecture design and visual collaboration tool. This is the parser for Feakin.1 version - Latest release: over 1 year ago - 1.28 thousand downloads total - 45 stars on GitHub - 1 maintainer
inf-wast 0.0.8 💰
inf-wasm-tool inf-wast crate fork with Inference non-detenministic instructions extension8 versions - Latest release: 3 months ago - 4.35 thousand downloads total - 2 stars on GitHub - 1 maintainer
tin 0.3.0
tin: a statically structurally typed embeddable programming language6 versions - Latest release: over 6 years ago - 9.73 thousand downloads total - 64 stars on GitHub - 1 maintainer
inf-wasmparser 0.0.8 💰
A simple event-driven library for parsing Inferara non-deterministic WASM extension WebAssembly b...4 versions - Latest release: 3 months ago - 1.96 thousand downloads total - 2 stars on GitHub - 1 maintainer
candle-coreml 0.1.0
CoreML inference engine for Candle tensors - provides Apple CoreML integration for efficient on-d...1 version - Latest release: 3 days ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
inference_core 0.1.0
Feakin is a architecture design and visual collaboration tool. This is the parser for Feakin.1 version - Latest release: over 1 year ago - 1.31 thousand downloads total - 45 stars on GitHub - 2 maintainers
runnx 0.1.1
A minimal, verifiable ONNX runtime implementation in Rust2 versions - Latest release: 3 days ago - 143 downloads total - 0 stars on GitHub - 1 maintainer
enfer_core 0.1.2
Feakin is a architecture design and visual collaboration tool. This is the parser for Feakin.3 versions - Latest release: over 1 year ago - 3.77 thousand downloads total - 45 stars on GitHub - 1 maintainer
specs-visitor 0.3.0
Utilities for visiting entities in an ECS that is using the specs library.4 versions - Latest release: over 6 years ago - 3 dependent packages - 1 dependent repositories - 7.86 thousand downloads total - 64 stars on GitHub - 1 maintainer
curtana 0.1.1
Simplified zero-cost wrapper over llama.cpp powered by lama-cpp-2.3 versions - Latest release: 16 days ago - 806 downloads total - 1 stars on GitHub - 1 maintainer
bitnet-cpp-sys 0.0.5
Low Level Bindings to bitnet.cpp5 versions - Latest release: 7 months ago - 5.07 thousand downloads total - 1 maintainer
ort-candle 0.1.0+0.8 💰
ort + candle = 🦀 - An alternative backend for ort, powered by candle.1 version - Latest release: about 2 months ago - 306 downloads total - 1,437 stars on GitHub - 1 maintainer
ort-tract 0.1.0+0.21 💰
ort + tract = 🦀 - An alternative backend for ort, powered by tract.1 version - Latest release: about 2 months ago - 436 downloads total - 1,437 stars on GitHub - 1 maintainer
Top 6.4% on crates.io
40 versions - Latest release: over 1 year ago - 26 dependent packages - 32 dependent repositories - 2.91 million downloads total - 529 stars on GitHub - 1 maintainer
ort 1.16.3 💰
A safe Rust wrapper for ONNX Runtime 1.22 - Optimize and accelerate machine learning inference & ...40 versions - Latest release: over 1 year ago - 26 dependent packages - 32 dependent repositories - 2.91 million downloads total - 529 stars on GitHub - 1 maintainer
ort-sys 2.0.0-rc.10 💰
Unsafe Rust bindings for ONNX Runtime 1.22 - Optimize and Accelerate Machine Learning Inferencing16 versions - Latest release: about 2 months ago - 1 dependent package - 2.64 million downloads total - 529 stars on GitHub - 1 maintainer
lmcpp 0.1.0
Rust bindings for llama.cpp's server with managed toolchain, typed endpoints, and UDS/HTTP support1 version - Latest release: 5 days ago - 0 downloads total - 203 stars on GitHub - 1 maintainer
orkhon 0.2.3 💰
Machine Learning Inference Framework and Server Runtime8 versions - Latest release: over 4 years ago - 25.2 thousand downloads total - 145 stars on GitHub - 1 maintainer
wat-fmt 0.0.8 💰
A pretty formatter for WebAssembly Text Format1 version - Latest release: 3 months ago - 455 downloads total - 2 stars on GitHub - 1 maintainer
bitnet-inference 0.1.1
High-performance inference engine for BitNet models2 versions - Latest release: 7 days ago - 154 downloads total - 1 stars on GitHub - 1 maintainer
lllllxxxxx 0.0.7
TypeQL Grammar for Rust7 versions - Latest release: over 3 years ago - 8.08 thousand downloads total - 231 stars on GitHub - 1 maintainer
ask-bayes 0.2.1 💰
CLI tool for Bayesian inference6 versions - Latest release: over 3 years ago - 7.52 thousand downloads total - 1 stars on GitHub - 1 maintainer
wasi-nn-safe 0.1.0
High-level and Safe Rust API bindings for wasi-nn system calls7 versions - Latest release: about 2 years ago - 7.92 thousand downloads total - 0 stars on GitHub - 1 maintainer
tin-lang 0.2.2
tin: a statically structurally typed embeddable programming language4 versions - Latest release: over 6 years ago - 5.54 thousand downloads total - 64 stars on GitHub - 1 maintainer
genson-rs 0.2.0
Extremely fast JSON Schema inference engine built in Rust2 versions - Latest release: about 1 year ago - 2.49 thousand downloads total - 80 stars on GitHub - 1 maintainer
bayes 0.0.1
Composable abstractions to build probabilistic models and inference algorithms1 version - Latest release: about 5 years ago - 1.55 thousand downloads total - 1 maintainer
asdi 0.2.5
Another Simplistic Datalog Implementation (in Rust)7 versions - Latest release: over 3 years ago - 8.84 thousand downloads total - 4 stars on GitHub - 1 maintainer
pipeless-ai 1.11.0
An open-source computer vision framework to build and deploy applications in minutes26 versions - Latest release: over 1 year ago - 27.4 thousand downloads total - 756 stars on GitHub - 1 maintainer
triton-client 0.2.0
A client for interfacing with NVIDIA Triton inference server.3 versions - Latest release: almost 3 years ago - 6.95 thousand downloads total - 30 stars on GitHub - 2 maintainers
typeql 3.2.0
TypeQL Language for Rust24 versions - Latest release: 3 months ago - 1 dependent package - 19.1 thousand downloads total - 229 stars on GitHub - 1 maintainer
typeql_lang
TypeQL Language for Rust1 version - Latest release: 14 days ago - 1 dependent package - 985 downloads total - 229 stars on GitHub - 2 maintainers
leaves-rs 0.0.1
Pure Rust implementation of prediction part for GBRT (Gradient Boosting Regression Trees) models ...1 version - Latest release: 8 months ago - 739 downloads total - 0 stars on GitHub - 1 maintainer
llmnop 0.2.0
A command-line tool for benchmarking the performance of LLM inference endpoints.2 versions - Latest release: 14 days ago - 148 downloads total - 0 stars on GitHub - 1 maintainer
moonlite 0.1.0
A machine learning framework for efficient, cost-effective, scalable inference, and distributed, ...1 version - Latest release: 5 months ago - 484 downloads total - 0 stars on GitHub - 1 maintainer
fashion-clip-rs 0.1.5
A complete(grpc service and lib) Rust inference with multilingual embedding support. This version...5 versions - Latest release: over 1 year ago - 5.93 thousand downloads total - 39 stars on GitHub - 1 maintainer
cerebras-rs 0.0.2
High-performance Rust SDK for Cerebras Inference API - Low-latency AI model inference powered by ...2 versions - Latest release: about 2 months ago - 494 downloads total - 1 maintainer
onnxruntime 0.0.14
Wrapper around Microsoft's ONNX Runtime13 versions - Latest release: almost 4 years ago - 2 dependent packages - 5 dependent repositories - 59.8 thousand downloads total - 300 stars on GitHub - 1 maintainer
onnxruntime-sys-ng 1.16.1
Unsafe wrapper around Microsoft's ONNX Runtime2 versions - Latest release: over 1 year ago - 1 dependent package - 3.11 thousand downloads total - 300 stars on GitHub - 1 maintainer
onnxruntime-ng 1.16.1
Wrapper around Microsoft's ONNX Runtime2 versions - Latest release: over 1 year ago - 2.54 thousand downloads total - 300 stars on GitHub - 1 maintainer
triton-distributed 0.1.2+cb8ea1b
Distributed GenAI Inference Framework2 versions - Latest release: 6 months ago - 1.24 thousand downloads total - 49 stars on GitHub - 2 maintainers
onnxruntime-sys-patch 0.0.14
Unsafe wrapper around Microsoft's ONNX Runtime1 version - Latest release: over 3 years ago - 1.41 thousand downloads total - 297 stars on GitHub - 1 maintainer
Top 9.0% on crates.io
13 versions - Latest release: almost 4 years ago - 2 dependent packages - 9 dependent repositories - 71.4 thousand downloads total - 297 stars on GitHub - 1 maintainer
onnxruntime-sys 0.0.14
Unsafe wrapper around Microsoft's ONNX Runtime13 versions - Latest release: almost 4 years ago - 2 dependent packages - 9 dependent repositories - 71.4 thousand downloads total - 297 stars on GitHub - 1 maintainer
llama-rust 0.1.0
LLM inference in Rust1 version - Latest release: 24 days ago - 172 downloads total - 0 stars on GitHub - 1 maintainer
tritonserver-rs 0.4.1
Pefrorm easy and efficient ML models inference7 versions - Latest release: 17 days ago - 3.63 thousand downloads total - 23 stars on GitHub - 1 maintainer
bitnet-cpp 0.0.5
bitnet.cpp bindings for Rust4 versions - Latest release: 7 months ago - 2.81 thousand downloads total - 1 maintainer
libinfer 0.0.1
Rust interface to TensorRT for high-performance GPU inference1 version - Latest release: about 2 months ago - 355 downloads total - 1 stars on GitHub - 1 maintainer
streamfer 0.1.0
Streaming inference server1 version - Latest release: almost 2 years ago - 1.22 thousand downloads total - 1 maintainer
ai_kit 0.1.0
Collection of classic AI algorithms with convenient interfaces1 version - Latest release: almost 8 years ago - 2.02 thousand downloads total - 13 stars on GitHub - 1 maintainer
programinduction 0.9.0
A library for program induction and learning representations.37 versions - Latest release: over 1 year ago - 3 dependent repositories - 49.7 thousand downloads total - 30 stars on GitHub - 2 maintainers
kn-cuda-sys 0.7.3
A wrapper around the CUDA APIs15 versions - Latest release: about 1 year ago - 2 dependent packages - 17.5 thousand downloads total - 62 stars on GitHub - 1 maintainer
kn-graph 0.7.3
A neural network inference graph intermediate representation, with surrounding utilities.17 versions - Latest release: about 1 year ago - 2 dependent packages - 19.1 thousand downloads total - 62 stars on GitHub - 1 maintainer
kn-runtime 0.7.3
Dynamic wrapper around CPU and GPU inference6 versions - Latest release: about 1 year ago - 7.09 thousand downloads total - 62 stars on GitHub - 1 maintainer
kn-cuda-eval 0.7.3
A CUDA executor for neural network graphs15 versions - Latest release: about 1 year ago - 1 dependent package - 17.3 thousand downloads total - 62 stars on GitHub - 1 maintainer
bayes-rs 0.1.0
A Rust library for Bayesian inference with MCMC samplers1 version - Latest release: 24 days ago - 0 downloads total - 1 maintainer
type_eq 0.1.2
Tiny utils for type-level constraints and inference3 versions - Latest release: almost 7 years ago - 4.14 thousand downloads total - 0 stars on GitHub - 1 maintainer
mlua-tract 0.1.2
Lua bindings for tract, the tiny, no-nonsense, self-contained, Rust-based Tensorflow and ONNX inf...3 versions - Latest release: over 1 year ago - 3.91 thousand downloads total - 0 stars on gitlab.com - 1 maintainer
polytype 7.0.1
A Hindley-Milner polymorphic typing system.34 versions - Latest release: over 1 year ago - 1 dependent package - 7 dependent repositories - 65.9 thousand downloads total - 58 stars on GitHub - 2 maintainers
inference_graph 0.1.0
For building graphs of async tasks by having each node only refer to its own inputs.1 version - Latest release: over 2 years ago - 1.31 thousand downloads total - 0 stars on GitHub - 1 maintainer
llmterm 0.2.3 💰
Your friendly local LLM terminal companion2 versions - Latest release: 5 months ago - 865 downloads total - 8 stars on GitHub - 1 maintainer
infers-jsonschema 0.1.0 💰
A crate for inferring JSON Schema from input data1 version - Latest release: over 5 years ago - 1 dependent package - 2 dependent repositories - 3.77 thousand downloads total - 8 stars on GitHub - 1 maintainer
specs-visitor-derive 0.3.0
A procedural macro for deriving traits in specs-derive.4 versions - Latest release: over 6 years ago - 2 dependent packages - 1 dependent repositories - 6.78 thousand downloads total - 64 stars on GitHub - 1 maintainer
inference-gateway 0.1.0 removed
Rust SDK for interacting with various language models through the Inference Gateway1 version - Latest release: 6 months ago - 0 downloads total - 0 stars on GitHub - 1 maintainer
Related Keywords
rust
24
onnx
16
machine-learning
16
llm
11
onnxruntime
10
ai
10
bindings
7
onnx-runtime
7
machinelearning
7
language
6
onnxruntime-sys
5
neuralnetworks
5
rust-wrapper
5
ml
5
model
4
llama
4
polymorphism
4
structural-typing
4
jit-compiler
4
logic
4
jit
4
embeddable
4
wasm
4
deep-learning
3
async
3
bitnet
3
database
3
sys
3
statistics
3
bayesian
3
api-bindings
3
typeql
3
typedb
3
type-system
3
strongly-typed
3
reasoning
3
query-language
3
query
3
edge
3
polymorphic
3
webassembly
3
formal-methods
3
formal-specification
3
graph
2
tensorflow
2
inference-server
2
learning
2
server
2
triton
2
nvidia
2
cpp
2
sdk
2
gateway
2
inference-gateway
2
rust-sdk
2
parser
2
candle
2
neural-network
2
embedding
2
fine-tuning
2
cuda
2
ai-training
2
bitnet-cpp
2
type
2
vision-framework
1
yolo
1
ggml-rs
1
genai
1
gradient-boosting
1
lightgbm
1
machine
1
fashion
1
clip-multilingual
1
benchmark
1
distributed
1
openai
1
performance
1
clip
1
performance-metrics
1
cerebras
1
api
1
grpc
1
clip-vit
1
fashion-clip
1
jsonschema
1
terminal
1
shell
1
local-llm
1
kalosm
1
assistant
1
dag
1
types
1
type-inference
1
hindley-milner
1
unification
1
typing
1
lua
1
equality
1
mcmc
1
sampling
1