Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

crates.io "llm" keyword

shai 0.2.0
A shell AI assistant
4 versions - Latest release: 6 months ago - 1.22 thousand downloads total - 13 stars on GitHub - 1 maintainer
web-rwkv-converter 0.1.2
Converts an RWKV PTH model to SafeTensors.
2 versions - Latest release: 13 days ago - 980 downloads total - 3 stars on GitHub - 1 maintainer
chat-templates 0.3.0
Simple chat templates parser/generator for prompting LLM
3 versions - Latest release: about 1 month ago - 840 downloads total - 0 stars on GitHub - 1 maintainer
prompt_def 0.1.0
A rust library to parse prompts defined as prompts schema format, see https://github.com/prompt-n...
1 version - Latest release: 11 months ago - 364 downloads total - 1 maintainer
kalosm 0.2.1 💰
A simple interface for pretrained AI models
3 versions - Latest release: 3 months ago - 1.25 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-sample 0.2.1 💰
A common interface for token sampling and helpers for structered llm sampling
3 versions - Latest release: 3 months ago - 5 dependent packages - 1.4 thousand downloads total - 938 stars on GitHub - 1 maintainer
kalosm-llama 0.2.2 💰
A simple interface for Llama models
4 versions - Latest release: 3 months ago - 2 dependent packages - 1.61 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-vision 0.2.1 💰
A set of pretrained vision models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.27 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-language-model 0.2.1 💰
A common interface for language models/transformers
3 versions - Latest release: 3 months ago - 6 dependent packages - 1.39 thousand downloads total - 938 stars on GitHub - 1 maintainer
pllm 0.4.1
Portable LLM
6 versions - Latest release: about 2 months ago - 2.03 thousand downloads total - 8 stars on GitHub - 1 maintainer
segment-anything-rs 0.2.1 💰
A simple interface for Segment Anything models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.3 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-learning 0.2.1 💰
A simplified machine learning library for building off of pretrained models.
3 versions - Latest release: 3 months ago - 982 downloads total - 472 stars on GitHub - 1 maintainer
kalosm-ocr 0.2.1 💰
A simple interface for pretrained OCR models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.27 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-streams 0.2.1 💰
A set of streams for pretrained models in Kalosm
3 versions - Latest release: 3 months ago - 8 dependent packages - 1.47 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-language 0.2.2 💰
A set of pretrained language models
5 versions - Latest release: 3 months ago - 1 dependent package - 1.87 thousand downloads total - 472 stars on GitHub - 1 maintainer
rphi 0.2.1 💰
A simple interface for Phi models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.35 thousand downloads total - 472 stars on GitHub - 1 maintainer
rwuerstchen 0.2.1 💰
A simple interface for RWuerstchen image generation models models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.24 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-learning-macro 0.2.1 💰
A macro to derive kalosm learning traits
3 versions - Latest release: 3 months ago - 1 dependent package - 1 thousand downloads total - 472 stars on GitHub - 1 maintainer
rbert 0.2.1 💰
A simple interface for Bert embeddings
3 versions - Latest release: 3 months ago - 2 dependent packages - 1.31 thousand downloads total - 472 stars on GitHub - 1 maintainer
rmistral 0.1.0 💰
A simple interface for Mistral models
1 version - Latest release: 5 months ago - 1 dependent package - 367 downloads total - 472 stars on GitHub - 1 maintainer
kalosm-sound 0.2.1 💰
A set of pretrained audio models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.28 thousand downloads total - 472 stars on GitHub - 1 maintainer
rwhisper 0.2.1 💰
A simple interface for Whisper transcription models in Rust
5 versions - Latest release: 3 months ago - 1 dependent package - 1.79 thousand downloads total - 472 stars on GitHub - 1 maintainer
dify-client 0.3.0
A client for the Dify API
9 versions - Latest release: 16 days ago - 1.5 thousand downloads total - 0 stars on GitHub - 1 maintainer
cunw 0.2.1
A tiny utility that generates a file representing the structure and content of a directory. Made ...
2 versions - Latest release: 16 days ago - 224 downloads total - 1 stars on GitHub - 1 maintainer
openai-magic-instantiate-derive 0.2.0
Derive macro for `openai-magic-instantiate crate`
8 versions - Latest release: 4 months ago - 1 dependent package - 2.39 thousand downloads total - 4 stars on GitHub - 1 maintainer
llama_cpp_low 0.3.5
small server binary compile build from llama.cpp
7 versions - Latest release: 19 days ago - 1 dependent package - 930 downloads total - 0 stars on GitHub - 1 maintainer
burn-wgpu 0.13.2 💰
WGPU backend for the Burn framework
10 versions - Latest release: 25 days ago - 3 dependent packages - 2 dependent repositories - 45.7 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
Top 6.2% on crates.io
burn-ndarray 0.13.2 💰
Ndarray backend for the Burn framework
15 versions - Latest release: 25 days ago - 8 dependent packages - 17 dependent repositories - 61.9 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
burn-jit 0.13.2 💰
Generic backend that can be compiled just-in-time to any shader language target
3 versions - Latest release: 25 days ago - 1 dependent package - 1.1 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
burn-import 0.13.2 💰
Library for importing datamodels into the Burn framework
11 versions - Latest release: 25 days ago - 1 dependent package - 3.51 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
burn-fusion 0.13.2 💰
Kernel fusion backend decorator for the Burn framework
7 versions - Latest release: 25 days ago - 3 dependent packages - 42.6 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
Top 6.0% on crates.io
burn-autodiff 0.13.2 💰
Automatic differentiation backend for the Burn framework
15 versions - Latest release: 25 days ago - 9 dependent packages - 17 dependent repositories - 64.6 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
Top 7.1% on crates.io
burn 0.13.2 💰
Flexible and Comprehensive Deep Learning Framework in Rust
20 versions - Latest release: 25 days ago - 7 dependent packages - 17 dependent repositories - 64.8 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
aichat 0.17.0
All-in-one AI-Powered CLI Chat & Copilot
17 versions - Latest release: 15 days ago - 9.2 thousand downloads total - 2,630 stars on GitHub - 1 maintainer
openai-magic-instantiate 0.2.2
Use LLMs to instantiate well-typed values
11 versions - Latest release: 4 months ago - 3.1 thousand downloads total - 4 stars on GitHub - 1 maintainer
anchor-chain 0.4.2
A statically typed async framework for building LLM-based applications.
7 versions - Latest release: 16 days ago - 1.38 thousand downloads total - 0 stars on GitHub - 1 maintainer
Top 8.2% on crates.io
burn-train 0.13.2 💰
Training crate for the Burn framework
13 versions - Latest release: 25 days ago - 1 dependent package - 15 dependent repositories - 61.4 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
burn-tch 0.13.2 💰
LibTorch backend for the Burn framework using the tch bindings.
15 versions - Latest release: 25 days ago - 3 dependent packages - 17 dependent repositories - 46.3 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
Top 7.2% on crates.io
burn-dataset 0.13.2 💰
Library with simple dataset APIs for creating ML data pipelines
17 versions - Latest release: 25 days ago - 2 dependent packages - 19 dependent repositories - 64.7 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
Top 7.1% on crates.io
burn-core 0.13.2 💰
Flexible and Comprehensive Deep Learning Framework in Rust
13 versions - Latest release: 25 days ago - 2 dependent packages - 17 dependent repositories - 64.1 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
oxidized-transformers 0.1.1
Transformers library (not functional yet)
2 versions - Latest release: 2 months ago - 646 downloads total - 32 stars on GitHub - 1 maintainer
oxidized-cuda-kernels 0.1.1
Additional CUDA kernels for Oxidized Transformers
1 version - Latest release: 2 months ago - 288 downloads total - 32 stars on GitHub - 1 maintainer
rsllm 0.6.2
Rust AI Stream Analyzer Twitch Bot
24 versions - Latest release: 20 days ago - 5.89 thousand downloads total - 6 stars on GitHub - 1 maintainer
mechanise 0.0.2
A, _hopefully_ Rusty wrapper for the Anthropic REST API for Anthropic's `claude` and maybe someda...
2 versions - Latest release: 3 months ago - 709 downloads total - 1 stars on GitHub - 1 maintainer
aleph-alpha-api 0.1.0
Interact with large language models provided by the Aleph Alpha API in Rust code
1 version - Latest release: 6 months ago - 276 downloads total - 1 stars on GitHub
llm-sdk 0.4.2
A simple SDK for OpenAI compatible API.
6 versions - Latest release: 4 months ago - 1.82 thousand downloads total - 42 stars on GitHub - 1 maintainer
llm-daemon 0.3.5
LLM as a daemon
20 versions - Latest release: 19 days ago - 3.72 thousand downloads total - 0 stars on GitHub - 1 maintainer
gguf-rs 0.1.3
GGUF file parser
4 versions - Latest release: 4 months ago - 1.2 thousand downloads total - 4 stars on GitHub - 1 maintainer
gptui 0.1.0
A TUI interface for OpenAI Chat Completions
1 version - Latest release: 5 months ago - 260 downloads total - 2 stars on GitHub - 1 maintainer
llmchain 0.1.3
A Rust framework for large language models, inspired by LangChain
4 versions - Latest release: 9 months ago - 1.44 thousand downloads total - 160 stars on GitHub - 2 maintainers
rs-llama-cpp 0.1.67
Automated Rust bindings generation for LLaMA.cpp
62 versions - Latest release: 10 months ago - 15 thousand downloads total - 4 stars on GitHub - 1 maintainer
burn-candle 0.13.2 💰
Candle backend for the Burn framework
8 versions - Latest release: 25 days ago - 1 dependent package - 5 dependent repositories - 42.8 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
tenere 0.11.1
TUI interface for LLMs written in Rust
7 versions - Latest release: 2 months ago - 2.25 thousand downloads total - 212 stars on GitHub - 1 maintainer
ask-ollama 1.0.5
Query any LLM found on Ollama from the terminal!
7 versions - Latest release: 6 months ago - 1.81 thousand downloads total - 7 stars on GitHub - 1 maintainer
qllm 0.2.0
Query any LLM found on Ollama from the terminal!
2 versions - Latest release: 6 months ago - 550 downloads total - 0 stars on GitHub - 1 maintainer
cai 0.6.0 💰
The fastest CLI tool for prompting LLMs
6 versions - Latest release: 29 days ago - 1.64 thousand downloads total - 30 stars on GitHub - 1 maintainer
augre 0.1.0 💰
An LLM-powered (CodeLlama or OpenAI) local diff code review tool.
1 version - Latest release: 8 months ago - 313 downloads total - 19 stars on GitHub - 1 maintainer
claude_cli 0.1.3
Rust CLI to interact with Anthropic's Language model (Claude) in the terminal
4 versions - Latest release: 5 months ago - 1.01 thousand downloads total - 2 stars on GitHub - 1 maintainer
mistralai-client 0.9.0 💰
Mistral AI API client library for Rust (unofficial).
9 versions - Latest release: about 2 months ago - 2.91 thousand downloads total - 2 stars on GitHub - 1 maintainer
palm_api 0.2.1
Client library for Google's large language model PaLM API
4 versions - Latest release: 10 months ago - 1.08 thousand downloads total - 0 stars on GitHub - 1 maintainer
tuigents 0.1.1
A TUI focused interface for locally running, managing, and monitoring AI agents using local knowl...
2 versions - Latest release: 28 days ago - 0 downloads total - 1 maintainer
psource 0.4.0
CLI tool to pretty print source code to stdout or directly to the clipboard.
11 versions - Latest release: 4 months ago - 2.89 thousand downloads total - 1 stars on GitHub - 1 maintainer
llama-rs 0.0.0
Run inference for Facebook's LLaMA model in CPU using ggml.
1 version - Latest release: about 1 year ago - 384 downloads total - 5,897 stars on GitHub - 1 maintainer
Related Keywords
rust 80 ai 67 chatgpt 34 openai 31 machine-learning 27 langchain 25 llama 23 chain 23 cli 21 onnx 20 deep-learning 20 neural-network 19 ggml 19 pytorch 18 wasm 18 high-performance 17 kernel-fusion 17 cross-platform 17 ndarray 17 autodiff 17 scientific-computing 17 autotune 17 concurrency 17 tensor 17 webgpu 17 gpt 16 floneum 15 ml 14 nlp 13 text-summary 12 data 8 agent 8 mistral 8 model 6 anthropic 6 claude 6 transformers 6 chatbot 6 ollama 5 chat 5 candle 5 bert 5 gpu 5 prompt 4 graph 4 sdk 4 kawaii 4 api 4 terminal 4 openai-api 4 llama2 3 whisper 3 ocr 3 edge 3 python 3 qdrant 3 inference 3 observability 3 proxy 3 logging 3 llms 3 llamacpp 3 gguf 3 code 3 command-line 3 rwkv 2 shell 2 derive 2 magic 2 prompt-engineering 2 assistant 2 schema 2 bindings 2 mlops 2 roberta 2 command-line-tool 2 repl 2 floneum-v3 2 kalosm 2 dify 2 aigc 2 segment-anything 2 huggingface 2 large-language-models 2 llama-cpp 2 gpt4 2 tui 2 tts 2 chatgpt-api 2 text-generation 2 copilot 2 git 2 gpt-4 2 autogpt 2 aleph-alpha 2 unix 2 stable-diffusion 2 trusted-execution-environment 2 tee 2 gemini 2