Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

crates.io "llm" keyword

dify-client 0.3.0
A client for the Dify API
9 versions - Latest release: 1 day ago - 1.5 thousand downloads total - 0 stars on GitHub - 1 maintainer
cunw 0.2.1
A tiny utility that generates a file representing the structure and content of a directory. Made ...
2 versions - Latest release: 1 day ago - 224 downloads total - 1 stars on GitHub - 1 maintainer
wasmedge-wasi-nn 0.7.1
High-level Rust bindings for wasi-nn, with LLM extensions.
2 versions - Latest release: 21 days ago - 1 dependent package - 4.45 thousand downloads total - 0 stars on GitHub - 2 maintainers
trustedflow-attestation-sys 0.1.1-dev240313
Trustedflow Attestation Rust Library
4 versions - Latest release: 2 months ago - 1 dependent package - 1.57 thousand downloads total - 9 stars on GitHub - 1 maintainer
sllm-rs 0.1.6
A simple library designed for integrating and interacting with various GPT-like APIs.
5 versions - Latest release: 26 days ago - 1 dependent package - 898 downloads total - 1 stars on GitHub - 1 maintainer
segment-anything-rs 0.2.1 💰
A simple interface for Segment Anything models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.14 thousand downloads total - 472 stars on GitHub - 1 maintainer
rwuerstchen 0.2.1 💰
A simple interface for RWuerstchen image generation models models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.07 thousand downloads total - 472 stars on GitHub - 1 maintainer
rwhisper 0.2.1 💰
A simple interface for Whisper transcription models in Rust
5 versions - Latest release: 3 months ago - 1 dependent package - 1.55 thousand downloads total - 472 stars on GitHub - 1 maintainer
rphi 0.2.1 💰
A simple interface for Phi models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.18 thousand downloads total - 472 stars on GitHub - 1 maintainer
rmistral 0.1.0 💰
A simple interface for Mistral models
1 version - Latest release: 5 months ago - 1 dependent package - 322 downloads total - 472 stars on GitHub - 1 maintainer
rbert 0.2.1 💰
A simple interface for Bert embeddings
3 versions - Latest release: 3 months ago - 2 dependent packages - 1.14 thousand downloads total - 472 stars on GitHub - 1 maintainer
qdrant_rest_client 0.1.0
The Qdrant SDK for WebAssembly.
5 versions - Latest release: 15 days ago - 1 dependent package - 2.16 thousand downloads total - 3 stars on GitHub - 1 maintainer
openai-magic-instantiate-derive 0.2.0
Derive macro for `openai-magic-instantiate crate`
8 versions - Latest release: 3 months ago - 1 dependent package - 2.39 thousand downloads total - 4 stars on GitHub - 1 maintainer
Top 6.9% on crates.io
llm-base 0.1.1
The base for `llm`; provides common structure for model implementations. Not intended for use by ...
5 versions - Latest release: about 1 year ago - 7 dependent packages - 11 dependent repositories - 9.57 thousand downloads total - 5,943 stars on GitHub - 2 maintainers
Top 7.7% on crates.io
llm 0.1.1
A Rust ecosystem of libraries for running inference on large language models, inspired by llama.cpp.
6 versions - Latest release: about 1 year ago - 5 dependent packages - 10 dependent repositories - 8.14 thousand downloads total - 5,943 stars on GitHub - 2 maintainers
llama_cpp_low 0.3.5
small server binary compile build from llama.cpp
7 versions - Latest release: 5 days ago - 1 dependent package - 930 downloads total - 0 stars on GitHub - 1 maintainer
lemon-graph 0.0.1
Async directed computation graphs.
2 versions - Latest release: 2 months ago - 1 dependent package - 693 downloads total - 1 stars on GitHub - 1 maintainer
langchain-rust 4.1.2
LangChain for Rust, the easiest way to write LLM-based programs in Rust
58 versions - Latest release: 4 days ago - 1 dependent package - 18.9 thousand downloads total - 198 stars on GitHub - 1 maintainer
kalosm-vision 0.2.1 💰
A set of pretrained vision models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.09 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-streams 0.2.1 💰
A set of streams for pretrained models in Kalosm
3 versions - Latest release: 3 months ago - 8 dependent packages - 1.27 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-sound 0.2.1 💰
A set of pretrained audio models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.11 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-sample 0.2.1 💰
A common interface for token sampling and helpers for structered llm sampling
3 versions - Latest release: 3 months ago - 5 dependent packages - 1.21 thousand downloads total - 938 stars on GitHub - 1 maintainer
kalosm-ocr 0.2.1 💰
A simple interface for pretrained OCR models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.09 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-llama 0.2.2 💰
A simple interface for Llama models
4 versions - Latest release: 3 months ago - 2 dependent packages - 1.38 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-learning-macro 0.2.1 💰
A macro to derive kalosm learning traits
3 versions - Latest release: 3 months ago - 1 dependent package - 875 downloads total - 472 stars on GitHub - 1 maintainer
kalosm-language-model 0.2.1 💰
A common interface for language models/transformers
3 versions - Latest release: 3 months ago - 6 dependent packages - 1.2 thousand downloads total - 938 stars on GitHub - 1 maintainer
kalosm-language 0.2.2 💰
A set of pretrained language models
5 versions - Latest release: 3 months ago - 1 dependent package - 1.62 thousand downloads total - 472 stars on GitHub - 1 maintainer
chronicle-proxy 0.1.4
LLM Provider Abstraction and Logging
5 versions - Latest release: 12 days ago - 2 dependent packages - 897 downloads total - 1 stars on GitHub - 1 maintainer
burn-wgpu 0.13.2 💰
WGPU backend for the Burn framework
10 versions - Latest release: 11 days ago - 3 dependent packages - 2 dependent repositories - 45.7 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
Top 7.2% on crates.io
burn-tensor-testgen 0.13.0 💰
Test generation crate for burn-tensor
13 versions - Latest release: about 1 month ago - 3 dependent packages - 17 dependent repositories - 47.9 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
Top 5.4% on crates.io
burn-tensor 0.13.0 💰
Tensor library with user-friendly APIs and automatic differentiation support
18 versions - Latest release: about 1 month ago - 9 dependent packages - 19 dependent repositories - 62.8 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
Top 6.2% on crates.io
burn-ndarray 0.13.2 💰
Ndarray backend for the Burn framework
15 versions - Latest release: 11 days ago - 8 dependent packages - 17 dependent repositories - 61.9 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
burn-jit 0.13.2 💰
Generic backend that can be compiled just-in-time to any shader language target
3 versions - Latest release: 11 days ago - 1 dependent package - 1.1 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
burn-import 0.13.2 💰
Library for importing datamodels into the Burn framework
11 versions - Latest release: 11 days ago - 1 dependent package - 3.51 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
burn-fusion 0.13.2 💰
Kernel fusion backend decorator for the Burn framework
7 versions - Latest release: 11 days ago - 3 dependent packages - 42.6 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
burn-compute 0.13.0 💰
Compute crate that helps creating high performance async backends.
6 versions - Latest release: about 1 month ago - 2 dependent packages - 1 dependent repositories - 39.5 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
Top 5.5% on crates.io
burn-common 0.13.0 💰
Common crate for the Burn framework
10 versions - Latest release: about 1 month ago - 10 dependent packages - 17 dependent repositories - 60.1 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
Top 6.0% on crates.io
burn-autodiff 0.13.2 💰
Automatic differentiation backend for the Burn framework
15 versions - Latest release: 11 days ago - 9 dependent packages - 17 dependent repositories - 64.6 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
Top 7.1% on crates.io
burn 0.13.2 💰
Flexible and Comprehensive Deep Learning Framework in Rust
20 versions - Latest release: 11 days ago - 7 dependent packages - 17 dependent repositories - 64.8 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
aichat 0.17.0
All-in-one AI-Powered CLI Chat & Copilot
17 versions - Latest release: about 12 hours ago - 9.2 thousand downloads total - 2,630 stars on GitHub - 1 maintainer
musicgpt 0.1.33
Generate music samples from natural language prompt locally with your own computer
15 versions - Latest release: about 18 hours ago - 2.11 thousand downloads total - 1 maintainer
code2prompt 1.1.0 💰
A command-line (CLI) tool to generate an LLM prompt from codebases of any size, fast.
2 versions - Latest release: 29 days ago - 946 downloads total - 293 stars on GitHub - 1 maintainer
openai-magic-instantiate 0.2.2
Use LLMs to instantiate well-typed values
11 versions - Latest release: 3 months ago - 3.1 thousand downloads total - 4 stars on GitHub - 1 maintainer
anchor-chain 0.4.2
A statically typed async framework for building LLM-based applications.
7 versions - Latest release: 1 day ago - 1.38 thousand downloads total - 0 stars on GitHub - 1 maintainer
ct2rs 0.8.0
Rust bindings for OpenNMT/CTranslate2
12 versions - Latest release: 1 day ago - 2.32 thousand downloads total - 6 stars on GitHub - 1 maintainer
Top 8.2% on crates.io
burn-train 0.13.2 💰
Training crate for the Burn framework
13 versions - Latest release: 11 days ago - 1 dependent package - 15 dependent repositories - 61.4 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
burn-tch 0.13.2 💰
LibTorch backend for the Burn framework using the tch bindings.
15 versions - Latest release: 11 days ago - 3 dependent packages - 17 dependent repositories - 46.3 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
Top 6.8% on crates.io
burn-derive 0.13.0 💰
Derive crate for the Burn framework
15 versions - Latest release: about 1 month ago - 2 dependent packages - 19 dependent repositories - 60.2 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
Top 7.2% on crates.io
burn-dataset 0.13.2 💰
Library with simple dataset APIs for creating ML data pipelines
17 versions - Latest release: 11 days ago - 2 dependent packages - 19 dependent repositories - 64.7 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
Top 7.1% on crates.io
burn-core 0.13.2 💰
Flexible and Comprehensive Deep Learning Framework in Rust
13 versions - Latest release: 11 days ago - 2 dependent packages - 17 dependent repositories - 64.1 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
llm-neox 0.1.1
An implementation of GPT-NeoX for the `llm` ecosystem.
5 versions - Latest release: about 1 year ago - 1 dependent package - 4 dependent repositories - 8.1 thousand downloads total - 5,943 stars on GitHub - 1 maintainer
Top 8.8% on crates.io
ggml-sys 0.1.1
Raw bindings (i.e. bindgen output) for the ggml library.
5 versions - Latest release: about 1 year ago - 1 dependent package - 11 dependent repositories - 10.2 thousand downloads total - 5,943 stars on GitHub - 2 maintainers
Top 9.8% on crates.io
llm-bloom 0.1.1
An implementation of BLOOM (BigScience Large Open-science Open-access Multilingual Language Model...
5 versions - Latest release: about 1 year ago - 1 dependent package - 10 dependent repositories - 7.94 thousand downloads total - 5,943 stars on GitHub - 2 maintainers
Top 9.6% on crates.io
llm-llama 0.1.1
An implementation of LLaMA (Large Language Model Meta AI) for the `llm` ecosystem.
5 versions - Latest release: about 1 year ago - 1 dependent package - 11 dependent repositories - 8.65 thousand downloads total - 5,943 stars on GitHub - 1 maintainer
Top 9.8% on crates.io
llm-gpt2 0.1.1
An implementation of GPT-2 for the `llm` ecosystem.
5 versions - Latest release: about 1 year ago - 1 dependent package - 10 dependent repositories - 8.1 thousand downloads total - 5,943 stars on GitHub - 2 maintainers
llm-cli 0.1.1
A CLI for running inference on supported Large Language Models. Powered by the `llm` library.
4 versions - Latest release: about 1 year ago - 2.61 thousand downloads total - 5,943 stars on GitHub - 1 maintainer
Top 9.2% on crates.io
ggml 0.1.1
Semi-idiomatic Rust bindings for the ggml library (from `ggml-sys`).
5 versions - Latest release: about 1 year ago - 1 dependent package - 5 dependent repositories - 9.99 thousand downloads total - 5,943 stars on GitHub - 2 maintainers
Top 9.8% on crates.io
llm-gptj 0.1.1
An implementation of GPT-J for the `llm` ecosystem.
5 versions - Latest release: about 1 year ago - 1 dependent package - 10 dependent repositories - 8.11 thousand downloads total - 5,943 stars on GitHub - 2 maintainers
oxidized-transformers 0.1.1
Transformers library (not functional yet)
2 versions - Latest release: about 2 months ago - 646 downloads total - 32 stars on GitHub - 1 maintainer
oxidized-cuda-kernels 0.1.1
Additional CUDA kernels for Oxidized Transformers
1 version - Latest release: about 2 months ago - 288 downloads total - 32 stars on GitHub - 1 maintainer
cgip 0.2.4
Terminal client for interacting with Chat GPT that allows you to build and manipulate contexts
13 versions - Latest release: 4 days ago - 3.27 thousand downloads total - 4 stars on GitHub - 1 maintainer
rsllm 0.6.2
Rust AI Stream Analyzer Twitch Bot
24 versions - Latest release: 5 days ago - 5.89 thousand downloads total - 6 stars on GitHub - 1 maintainer
mechanise 0.0.2
A, _hopefully_ Rusty wrapper for the Anthropic REST API for Anthropic's `claude` and maybe someda...
2 versions - Latest release: 2 months ago - 709 downloads total - 1 stars on GitHub - 1 maintainer
aleph-alpha-api 0.1.0
Interact with large language models provided by the Aleph Alpha API in Rust code
1 version - Latest release: 5 months ago - 276 downloads total - 1 stars on GitHub
llm-sdk 0.4.2
A simple SDK for OpenAI compatible API.
6 versions - Latest release: 4 months ago - 1.82 thousand downloads total - 42 stars on GitHub - 1 maintainer
chronicle-local 0.1.1
The Chronicle LLM proxy API, built for local use with SQLite and configuration files
1 version - Latest release: 5 days ago - 0 downloads total - 1 stars on GitHub - 1 maintainer
chronicle-api 0.1.1
LLM Provider Abstraction and Logging
1 version - Latest release: 5 days ago - 0 downloads total - 1 stars on GitHub - 1 maintainer
llm-daemon 0.3.5
LLM as a daemon
20 versions - Latest release: 5 days ago - 3.72 thousand downloads total - 0 stars on GitHub - 1 maintainer
trustedflow-attestation-rs 0.1.2-dev240313
Trustedflow Attestation Rust Library
5 versions - Latest release: 2 months ago - 1.62 thousand downloads total - 9 stars on GitHub - 1 maintainer
aleph-alpha-client 0.7.1
Interact with large language models provided by the Aleph Alpha API in Rust code
17 versions - Latest release: 6 months ago - 10.6 thousand downloads total - 7 stars on GitHub - 1 maintainer
gguf-rs 0.1.3
GGUF file parser
4 versions - Latest release: 3 months ago - 1.2 thousand downloads total - 4 stars on GitHub - 1 maintainer
gptui 0.1.0
A TUI interface for OpenAI Chat Completions
1 version - Latest release: 5 months ago - 260 downloads total - 2 stars on GitHub - 1 maintainer
llmchain 0.1.3
A Rust framework for large language models, inspired by LangChain
4 versions - Latest release: 8 months ago - 1.44 thousand downloads total - 160 stars on GitHub - 2 maintainers
rs-llama-cpp 0.1.67
Automated Rust bindings generation for LLaMA.cpp
62 versions - Latest release: 9 months ago - 15 thousand downloads total - 4 stars on GitHub - 1 maintainer
anthropic-sdk 0.1.0
Anthropic Rust SDK.
10 versions - Latest release: 10 days ago - 2.74 thousand downloads total - 3 stars on GitHub - 1 maintainer
tokengeex 1.0.0
TokenGeeX is an efficient tokenizer for code based on UnigramLM and TokenMonster.
9 versions - Latest release: 16 days ago - 2.84 thousand downloads total - 1 maintainer
burn-candle 0.13.2 💰
Candle backend for the Burn framework
8 versions - Latest release: 11 days ago - 1 dependent package - 5 dependent repositories - 42.8 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
tenere 0.11.1
TUI interface for LLMs written in Rust
7 versions - Latest release: about 2 months ago - 2.25 thousand downloads total - 212 stars on GitHub - 1 maintainer
llm-weaver 0.1.94
Manage long conversations with any LLM
19 versions - Latest release: 30 days ago - 4.72 thousand downloads total - 6 stars on GitHub - 1 maintainer
lucien 0.0.3
A loggin agent to work with LLM in Lucid Mode
3 versions - Latest release: 19 days ago - 706 downloads total - 0 stars on GitHub - 1 maintainer
ask-ollama 1.0.5
Query any LLM found on Ollama from the terminal!
7 versions - Latest release: 6 months ago - 1.81 thousand downloads total - 7 stars on GitHub - 1 maintainer
qllm 0.2.0
Query any LLM found on Ollama from the terminal!
2 versions - Latest release: 6 months ago - 550 downloads total - 0 stars on GitHub - 1 maintainer
cai 0.6.0 💰
The fastest CLI tool for prompting LLMs
6 versions - Latest release: 14 days ago - 1.64 thousand downloads total - 30 stars on GitHub - 1 maintainer
augre 0.1.0 💰
An LLM-powered (CodeLlama or OpenAI) local diff code review tool.
1 version - Latest release: 8 months ago - 313 downloads total - 19 stars on GitHub - 1 maintainer
claude_cli 0.1.3
Rust CLI to interact with Anthropic's Language model (Claude) in the terminal
4 versions - Latest release: 4 months ago - 1.01 thousand downloads total - 2 stars on GitHub - 1 maintainer
mistralai-client 0.9.0 💰
Mistral AI API client library for Rust (unofficial).
9 versions - Latest release: about 1 month ago - 2.91 thousand downloads total - 2 stars on GitHub - 1 maintainer
palm_api 0.2.1
Client library for Google's large language model PaLM API
4 versions - Latest release: 10 months ago - 1.08 thousand downloads total - 0 stars on GitHub - 1 maintainer
tuigents 0.1.1
A TUI focused interface for locally running, managing, and monitoring AI agents using local knowl...
2 versions - Latest release: 13 days ago - 0 downloads total - 1 maintainer
psource 0.4.0
CLI tool to pretty print source code to stdout or directly to the clipboard.
11 versions - Latest release: 4 months ago - 2.89 thousand downloads total - 1 stars on GitHub - 1 maintainer
llama-rs 0.0.0
Run inference for Facebook's LLaMA model in CPU using ggml.
1 version - Latest release: about 1 year ago - 384 downloads total - 5,897 stars on GitHub - 1 maintainer
babel-bridge 0.2.2
SDK for interacting with various Large Language Model (LLM) APIs
3 versions - Latest release: 16 days ago - 395 downloads total - 1 stars on GitHub - 1 maintainer
llm-api-adapter 0.2.1
SDK for interacting with various Large Language Model (LLM) APIs
6 versions - Latest release: 17 days ago - 957 downloads total - 0 stars on GitHub - 1 maintainer
mosec 0.8.4
Model Serving made Efficient in the Cloud.
40 versions - Latest release: 3 months ago - 10.9 thousand downloads total - 705 stars on GitHub - 2 maintainers
femto-gpt 0.1.0
Minimal Rust library for training GPT language-models
1 version - Latest release: 11 months ago - 350 downloads total - 697 stars on GitHub - 1 maintainer
smartcat 1.2.0
Putting a brain behind `cat`. CLI interface to bring language models in the Unix ecosystem 🐈‍⬛
32 versions - Latest release: 20 days ago - 7.1 thousand downloads total - 65 stars on GitHub - 1 maintainer
ollama-inquire 1.0.6
Query any LLM found on Ollama from the terminal!
7 versions - Latest release: about 2 months ago - 1.5 thousand downloads total - 0 stars on GitHub - 1 maintainer
smartgpt 0.1.9
A crate that provides LLMs with the ability to complete complex tasks using plugins.
10 versions - Latest release: 12 months ago - 2.55 thousand downloads total - 1,725 stars on GitHub - 1 maintainer
chatbotkit 0.0.1
The fastest way to build advanced AI chat bots.
1 version - Latest release: about 1 year ago - 298 downloads total - 0 stars on GitHub - 1 maintainer
jemini 0.1.1
THIS IS A WIP! (But the simplest functionality there) A, _hopefully_ Rusty wrapper for the Gemin...
2 versions - Latest release: 3 months ago - 777 downloads total - 5 stars on GitHub - 1 maintainer
acm-cli 0.3.1
A dead-simple AI-powered CLI tool for effortlessly crafting meaningful Git commit messages.
5 versions - Latest release: 22 days ago - 1.17 thousand downloads total - 18 stars on GitHub - 1 maintainer
Related Keywords
rust 78 ai 64 openai 27 chatgpt 26 machine-learning 25 llama 23 cli 21 onnx 20 deep-learning 19 neural-network 19 wasm 18 pytorch 18 kernel-fusion 17 ndarray 17 high-performance 17 cross-platform 17 concurrency 17 webgpu 17 autotune 17 tensor 17 autodiff 17 scientific-computing 17 ggml 15 floneum 15 gpt 15 langchain 15 chain 13 ml 13 nlp 13 text-summary 12 agent 8 mistral 8 data 7 transformers 6 chatbot 6 claude 6 model 5 chat 5 ollama 5 gpu 5 bert 5 candle 5 anthropic 4 sdk 4 prompt 4 kawaii 4 graph 4 terminal 4 edge 3 llama2 3 command-line 3 openai-api 3 inference 3 proxy 3 ocr 3 code 3 whisper 3 logging 3 observability 3 api 3 text-generation 2 tts 2 huggingface 2 aleph-alpha 2 assistant 2 large-language-models 2 stable-diffusion 2 roberta 2 bindings 2 tui 2 prompt-engineering 2 command-line-tool 2 gemini 2 gpt-4 2 copilot 2 gpt4 2 shell 2 repl 2 privacy-preserving 2 tee 2 privacy 2 trusted-execution-environment 2 meachine-learning 2 segment-anything 2 confidential-computing 2 unix 2 autogpt 2 python 2 qdrant 2 git 2 derive 2 magic 2 schema 2 llamacpp 2 kalosm 2 floneum-v3 2 llms 2 all-in-one 1 jupyter-notebook 1 model-serving 1