Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

crates.io "llm" keyword

tenere 0.11.1
TUI interface for LLMs written in Rust
7 versions - Latest release: 2 months ago - 2.58 thousand downloads total - 248 stars on GitHub - 1 maintainer
chronicle-local 0.1.1
The Chronicle LLM proxy API, built for local use with SQLite and configuration files
1 version - Latest release: 23 days ago - 220 downloads total - 2 stars on GitHub - 1 maintainer
chronicle-proxy 0.1.4
LLM Provider Abstraction and Logging
7 versions - Latest release: about 1 month ago - 2 dependent packages - 1.59 thousand downloads total - 2 stars on GitHub - 1 maintainer
chronicle-api 0.1.1
The Chronicle LLM proxy packaged as an API
2 versions - Latest release: 23 days ago - 412 downloads total - 2 stars on GitHub - 1 maintainer
mosec 0.8.4
Model Serving made Efficient in the Cloud.
40 versions - Latest release: 3 months ago - 12.9 thousand downloads total - 712 stars on GitHub - 2 maintainers
aichat 0.17.0
All-in-one AI CLI Tool
18 versions - Latest release: 19 days ago - 10.3 thousand downloads total - 2,630 stars on GitHub - 1 maintainer
tuigents 0.1.1
A TUI focused interface for locally running, managing, and monitoring AI agents using local knowl...
2 versions - Latest release: about 1 month ago - 462 downloads total - 1 maintainer
musicgpt 0.1.33
Generate music based on natural language prompts using LLMs running locally
21 versions - Latest release: 19 days ago - 4.38 thousand downloads total - 326 stars on GitHub - 1 maintainer
code2prompt 1.1.0 💰
A command-line (CLI) tool to generate an LLM prompt from codebases of any size, fast.
2 versions - Latest release: about 2 months ago - 1.12 thousand downloads total - 293 stars on GitHub - 1 maintainer
kalosm-language-model 0.2.1 💰
A common interface for language models/transformers
3 versions - Latest release: 3 months ago - 6 dependent packages - 1.57 thousand downloads total - 938 stars on GitHub - 1 maintainer
kalosm-sample 0.2.1 💰
A common interface for token sampling and helpers for structered llm sampling
3 versions - Latest release: 3 months ago - 5 dependent packages - 1.59 thousand downloads total - 938 stars on GitHub - 1 maintainer
kalosm-vision 0.2.1 💰
A set of pretrained vision models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.39 thousand downloads total - 472 stars on GitHub - 1 maintainer
rwuerstchen 0.2.1 💰
A simple interface for RWuerstchen image generation models models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.39 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-streams 0.2.1 💰
A set of streams for pretrained models in Kalosm
3 versions - Latest release: 3 months ago - 8 dependent packages - 1.67 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm 0.2.1 💰
A simple interface for pretrained AI models
3 versions - Latest release: 3 months ago - 1.36 thousand downloads total - 472 stars on GitHub - 1 maintainer
rbert 0.2.1 💰
A simple interface for Bert embeddings
3 versions - Latest release: 3 months ago - 2 dependent packages - 1.48 thousand downloads total - 472 stars on GitHub - 1 maintainer
rphi 0.2.1 💰
A simple interface for Phi models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.49 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-language 0.2.2 💰
A set of pretrained language models
5 versions - Latest release: 3 months ago - 1 dependent package - 2.05 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-ocr 0.2.1 💰
A simple interface for pretrained OCR models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.41 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-learning-macro 0.2.1 💰
A macro to derive kalosm learning traits
3 versions - Latest release: 3 months ago - 1 dependent package - 1.1 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-learning 0.2.1 💰
A simplified machine learning library for building off of pretrained models.
3 versions - Latest release: 3 months ago - 1.08 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-llama 0.2.2 💰
A simple interface for Llama models
4 versions - Latest release: 3 months ago - 2 dependent packages - 1.77 thousand downloads total - 472 stars on GitHub - 1 maintainer
segment-anything-rs 0.2.1 💰
A simple interface for Segment Anything models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.45 thousand downloads total - 472 stars on GitHub - 1 maintainer
kalosm-sound 0.2.1 💰
A set of pretrained audio models
3 versions - Latest release: 3 months ago - 1 dependent package - 1.41 thousand downloads total - 472 stars on GitHub - 1 maintainer
rmistral 0.1.0 💰
A simple interface for Mistral models
1 version - Latest release: 6 months ago - 1 dependent package - 412 downloads total - 472 stars on GitHub - 1 maintainer
rwhisper 0.2.1 💰
A simple interface for Whisper transcription models in Rust
5 versions - Latest release: 3 months ago - 1 dependent package - 2 thousand downloads total - 472 stars on GitHub - 1 maintainer
psource 0.4.0
CLI tool to pretty print source code to stdout or directly to the clipboard.
11 versions - Latest release: 4 months ago - 3.42 thousand downloads total - 1 stars on GitHub - 1 maintainer
llama-rs 0.0.0
Run inference for Facebook's LLaMA model in CPU using ggml.
1 version - Latest release: about 1 year ago - 449 downloads total - 5,965 stars on GitHub - 1 maintainer
aleph-alpha-client 0.7.1
Interact with large language models provided by the Aleph Alpha API in Rust code
18 versions - Latest release: 6 months ago - 11.6 thousand downloads total - 7 stars on GitHub - 1 maintainer
ct2rs 0.8.2
Rust bindings for OpenNMT/CTranslate2
15 versions - Latest release: 15 days ago - 3.59 thousand downloads total - 9 stars on GitHub - 1 maintainer
dify-client 0.3.0
A client for the Dify API
10 versions - Latest release: 19 days ago - 2.07 thousand downloads total - 0 stars on GitHub - 1 maintainer
dify-openai-apis
OpenAI-compatible APIs for Dify platform services
8 versions - 654 downloads total - 1 maintainer
llm_client
LLMs: structured text, decision making, classification, and benchmarks. A user friendly interface...
1 version - 0 downloads total - 17 stars on GitHub - 1 maintainer
llm_utils
Utilities for Llama.cpp, Openai, Anthropic, Mistral-rs.
3 versions - 330 downloads total - 3 stars on GitHub - 1 maintainer
femto-gpt 0.1.0
Minimal Rust library for training GPT language-models
2 versions - Latest release: 12 months ago - 413 downloads total - 713 stars on GitHub - 1 maintainer
llm-api-adapter 0.2.1
SDK for interacting with various Large Language Model (LLM) APIs using a common interface
7 versions - Latest release: about 1 month ago - 1.65 thousand downloads total - 0 stars on GitHub - 1 maintainer
babel-bridge 0.2.2
SDK for interacting with various Large Language Model (LLM) APIs using a common interface
4 versions - Latest release: about 1 month ago - 790 downloads total - 1 stars on GitHub - 1 maintainer
langchain-rust 4.1.2
LangChain for Rust, the easiest way to write LLM-based programs in Rust
60 versions - Latest release: 22 days ago - 1 dependent package - 21.5 thousand downloads total - 198 stars on GitHub - 1 maintainer
smartgpt 0.1.9
A crate that provides LLMs with the ability to complete complex tasks using plugins.
10 versions - Latest release: almost 1 year ago - 3.02 thousand downloads total - 1,724 stars on GitHub - 1 maintainer
Top 6.8% on crates.io
burn-derive 0.13.0 💰
Derive crate for the Burn framework
17 versions - Latest release: about 2 months ago - 2 dependent packages - 19 dependent repositories - 74.5 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
cgip 0.2.5
Terminal client for interacting with Chat GPT that allows you to build and manipulate contexts
15 versions - Latest release: 15 days ago - 3.81 thousand downloads total - 4 stars on GitHub - 1 maintainer
Top 7.2% on crates.io
burn-tensor-testgen 0.13.0 💰
Test generation crate for burn-tensor
15 versions - Latest release: about 2 months ago - 3 dependent packages - 17 dependent repositories - 49.9 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
burn-compute 0.13.0 💰
Compute crate that helps creating high performance async backends.
8 versions - Latest release: about 2 months ago - 2 dependent packages - 1 dependent repositories - 51.9 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
Top 5.5% on crates.io
burn-common 0.13.0 💰
Common crate for the Burn framework
12 versions - Latest release: about 2 months ago - 10 dependent packages - 17 dependent repositories - 73.1 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
Top 5.4% on crates.io
burn-tensor 0.13.0 💰
Tensor library with user-friendly APIs and automatic differentiation support
20 versions - Latest release: about 2 months ago - 9 dependent packages - 19 dependent repositories - 76 thousand downloads total - 7,029 stars on GitHub - 1 maintainer
transprompt 0.12.0-beta
Prompt-centric framework for developing LLM applications in Rust
1 version - Latest release: about 1 month ago - 247 downloads total - 4 stars on GitHub - 1 maintainer
ai00-core
An implementation of the RWKV language model in pure WebGPU.
2 versions - 166 downloads total - 400 stars on GitHub - 1 maintainer
ollama-inquire 1.0.6
Query any LLM found on Ollama from the terminal!
7 versions - Latest release: 2 months ago - 1.91 thousand downloads total - 0 stars on GitHub - 1 maintainer
chatbotkit 0.0.1
The fastest way to build advanced AI chat bots.
1 version - Latest release: about 1 year ago - 358 downloads total - 0 stars on GitHub - 1 maintainer
jemini 0.1.1
THIS IS A WIP! (But the simplest functionality there) A, _hopefully_ Rusty wrapper for the Gemin...
2 versions - Latest release: 3 months ago - 889 downloads total - 5 stars on GitHub - 1 maintainer
acm-cli 0.3.1
A dead-simple AI-powered CLI tool for effortlessly crafting meaningful Git commit messages.
5 versions - Latest release: about 1 month ago - 1.5 thousand downloads total - 18 stars on GitHub - 1 maintainer
wasmedge-wasi-nn 0.7.1
High-level Rust bindings for wasi-nn, with LLM extensions.
2 versions - Latest release: about 1 month ago - 1 dependent package - 7.21 thousand downloads total - 0 stars on GitHub - 2 maintainers
autogpt 0.0.1
🦀 A Pure Rust Framework For Building AGIs.
2 versions - Latest release: about 2 months ago - 294 downloads total - 8 stars on GitHub - 1 maintainer
flyteidl 0.1.0
Core Interface Definition for Flyte
1 version - Latest release: 16 days ago - 218 downloads total - 4,869 stars on GitHub - 1 maintainer
ai-chain-qwen
A library implementing `ai-chains` for moonshot OpenAI's models. Chains can be use to apply the m...
1 version - 0 downloads total - 1 stars on GitHub - 1 maintainer
ai-chain-milvus
Driver for the Milvus vector store
1 version - 0 downloads total - 1 stars on GitHub - 1 maintainer
ai-chain-qdrant
For using Qdrant with ai-chain
2 versions - 219 downloads total - 1 stars on GitHub - 1 maintainer
ai-chain
A library for running chains of LLMs (such as ChatGPT) in series to complete complex tasks, such ...
4 versions - 490 downloads total - 1 stars on GitHub - 1 maintainer
ai-chain-openai
A library implementing `ai-chains` for OpenAI's models. Chains can be use to apply the model seri...
3 versions - 351 downloads total - 1 stars on GitHub - 1 maintainer
ai-chain-openai-compatible
A library implementing `ai-chains` for OpenAI's models. Chains can be use to apply the model seri...
2 versions - 139 downloads total - 1 stars on GitHub - 1 maintainer
ai-chain-moonshot
A library implementing `ai-chains` for moonshot OpenAI's models. Chains can be use to apply the m...
3 versions - 358 downloads total - 1 stars on GitHub - 1 maintainer
ai-chain-macros
Set of macros for use with ai-chain
3 versions - 351 downloads total - 1 stars on GitHub - 1 maintainer
ai-chain-glm
A library implementing `ai-chains` for moonshot OpenAI's models. Chains can be use to apply the m...
2 versions - 136 downloads total - 1 stars on GitHub - 1 maintainer
Top 6.9% on crates.io
llm-base 0.1.1
The base for `llm`; provides common structure for model implementations. Not intended for use by ...
5 versions - Latest release: about 1 year ago - 7 dependent packages - 11 dependent repositories - 9.82 thousand downloads total - 5,964 stars on GitHub - 2 maintainers
Top 9.8% on crates.io
llm-gpt2 0.1.1
An implementation of GPT-2 for the `llm` ecosystem.
5 versions - Latest release: about 1 year ago - 1 dependent package - 10 dependent repositories - 8.33 thousand downloads total - 5,964 stars on GitHub - 2 maintainers
Top 9.2% on crates.io
ggml 0.1.1
Semi-idiomatic Rust bindings for the ggml library (from `ggml-sys`).
5 versions - Latest release: about 1 year ago - 1 dependent package - 5 dependent repositories - 10.2 thousand downloads total - 5,964 stars on GitHub - 2 maintainers
Top 7.7% on crates.io
llm 0.1.1
A Rust ecosystem of libraries for running inference on large language models, inspired by llama.cpp.
6 versions - Latest release: about 1 year ago - 5 dependent packages - 10 dependent repositories - 8.41 thousand downloads total - 5,964 stars on GitHub - 2 maintainers
Top 9.8% on crates.io
llm-bloom 0.1.1
An implementation of BLOOM (BigScience Large Open-science Open-access Multilingual Language Model...
5 versions - Latest release: about 1 year ago - 1 dependent package - 10 dependent repositories - 8.16 thousand downloads total - 5,964 stars on GitHub - 2 maintainers
llm-cli 0.1.1
A CLI for running inference on supported Large Language Models. Powered by the `llm` library.
4 versions - Latest release: about 1 year ago - 2.7 thousand downloads total - 5,964 stars on GitHub - 1 maintainer
Top 9.6% on crates.io
llm-llama 0.1.1
An implementation of LLaMA (Large Language Model Meta AI) for the `llm` ecosystem.
5 versions - Latest release: about 1 year ago - 1 dependent package - 11 dependent repositories - 8.88 thousand downloads total - 5,964 stars on GitHub - 1 maintainer
Top 9.8% on crates.io
llm-gptj 0.1.1
An implementation of GPT-J for the `llm` ecosystem.
5 versions - Latest release: about 1 year ago - 1 dependent package - 10 dependent repositories - 8.34 thousand downloads total - 5,964 stars on GitHub - 2 maintainers
llm-neox 0.1.1
An implementation of GPT-NeoX for the `llm` ecosystem.
5 versions - Latest release: about 1 year ago - 1 dependent package - 4 dependent repositories - 8.33 thousand downloads total - 5,964 stars on GitHub - 1 maintainer
Top 8.8% on crates.io
ggml-sys 0.1.1
Raw bindings (i.e. bindgen output) for the ggml library.
5 versions - Latest release: about 1 year ago - 1 dependent package - 11 dependent repositories - 10.5 thousand downloads total - 5,964 stars on GitHub - 2 maintainers
conva_ai 0.0.1
Rust SDK for using CONVA AI Copilots
3 versions - Latest release: about 1 month ago - 627 downloads total - 1 maintainer
llm-agent 0.1.0
reserved for library to build agent driven by llm.
1 version - Latest release: about 1 year ago - 357 downloads total - 1 maintainer
llmvm-outsource-lib 1.2.0
The library for the outsource backend for llmvm.
3 versions - Latest release: 4 months ago - 1 dependent package - 1.14 thousand downloads total - 70 stars on GitHub - 1 maintainer
llmvm-protocol 2.0.0
A library that contains protocol/communication elements for llmvm.
2 versions - Latest release: 4 months ago - 7 dependent packages - 1.83 thousand downloads total - 70 stars on GitHub - 1 maintainer
llmvm-codeassist 0.1.2
A LLM-powered code assistant that automatically retrieves context (i.e. type definitions) from a ...
3 versions - Latest release: 4 months ago - 979 downloads total - 70 stars on GitHub - 1 maintainer
llmvm-core-lib 1.0.1
The library for the llmvm core application.
2 versions - Latest release: 4 months ago - 1 dependent package - 886 downloads total - 70 stars on GitHub - 1 maintainer
llmvm-chat 0.1.1
An llmvm frontend that acts as a CLI chat interface.
2 versions - Latest release: 4 months ago - 625 downloads total - 70 stars on GitHub - 1 maintainer
llmvm-core 1.0.1
The core application for llmvm.
2 versions - Latest release: 4 months ago - 715 downloads total - 70 stars on GitHub - 1 maintainer
llmvm-outsource 1.2.0
An llmvm backend which sends text and chat generation requests to known hosted language model pro...
3 versions - Latest release: 4 months ago - 946 downloads total - 70 stars on GitHub - 1 maintainer
langchain_rs 0.0.2
Rust version of Langchain
2 versions - Latest release: 9 months ago - 665 downloads total - 39 stars on GitHub - 1 maintainer
oatmeal 0.13.0
Terminal UI to chat with large language models (LLM) using different model backends, and direct i...
37 versions - Latest release: 3 months ago - 10.6 thousand downloads total - 357 stars on GitHub - 1 maintainer
iwt 0.1.0
I Wish To.... transform piped data using OpenAI GPT API LLM
1 version - Latest release: 11 months ago - 350 downloads total - 10 stars on GitHub - 1 maintainer
coze 0.1.7
An egui app for playing with a local open source LLM.
8 versions - Latest release: 2 months ago - 3.02 thousand downloads total - 27 stars on GitHub - 1 maintainer
lemon-memory 0.0.1
Memory nodes for lemon-graph.
2 versions - Latest release: 3 months ago - 729 downloads total - 1 stars on GitHub - 1 maintainer
lemon-agent 0.0.1
Agent framework using lemon-graph.
2 versions - Latest release: 3 months ago - 759 downloads total - 1 stars on GitHub - 1 maintainer
lemon-graph 0.0.1
Async directed computation graphs.
2 versions - Latest release: 3 months ago - 1 dependent package - 769 downloads total - 1 stars on GitHub - 1 maintainer
lemon-llm 0.0.1
LLM nodes for lemon-graph.
2 versions - Latest release: 3 months ago - 749 downloads total - 1 stars on GitHub - 1 maintainer
ai-agents 0.2.3
a Rust library designed for building and managing generative AI agents, leveraging the capabiliti...
5 versions - Latest release: about 1 month ago - 1.33 thousand downloads total - 1 stars on GitHub - 1 maintainer
sllm-rs 0.1.6
A simple library designed for integrating and interacting with various GPT-like APIs.
5 versions - Latest release: about 1 month ago - 1 dependent package - 1.29 thousand downloads total - 1 stars on GitHub - 1 maintainer
kai-rs 0.1.0
A Rust library for using large language models via KoboldAI
1 version - Latest release: about 1 year ago - 341 downloads total - 0 stars on GitHub - 1 maintainer
Top 7.3% on crates.io
llm-chain 0.13.0
A library for running chains of LLMs (such as ChatGPT) in series to complete complex tasks, such ...
30 versions - Latest release: 7 months ago - 11 dependent packages - 10 dependent repositories - 26.2 thousand downloads total - 1,145 stars on GitHub - 1 maintainer
llm-chain-llama-sys 0.13.0
A library with bindings based on bindgen for LLaMA.cpp
26 versions - Latest release: 7 months ago - 1 dependent package - 2 dependent repositories - 7.94 thousand downloads total - 1,145 stars on GitHub - 1 maintainer
llm-chain-hnsw 0.13.0
For using hnsw with llm-chain
6 versions - Latest release: 7 months ago - 1.66 thousand downloads total - 1,145 stars on GitHub - 1 maintainer
llm-chain-tools 0.4.0
A library for providing Large Language Models with tools (also known as 'actions') that they can ...
5 versions - Latest release: about 1 year ago - 1.36 thousand downloads total - 1,145 stars on GitHub - 1 maintainer
llm-chain-llama 0.13.0
A library implementing `llm-chains` for LLamA. Chains can be use to apply the model series to com...
26 versions - Latest release: 7 months ago - 1 dependent repositories - 7.37 thousand downloads total - 1,145 stars on GitHub - 1 maintainer
llm-chain-macros 0.13.0
Set of macros for use with llm-chain
2 versions - Latest release: 7 months ago - 584 downloads total - 1,145 stars on GitHub - 1 maintainer
llm-chain-qdrant 0.13.0
For using Qdrant with llm-chain
9 versions - Latest release: 7 months ago - 2.62 thousand downloads total - 1,145 stars on GitHub - 1 maintainer
Related Keywords
rust 80 ai 67 chatgpt 34 openai 31 machine-learning 27 langchain 25 chain 23 llama 23 cli 21 onnx 20 deep-learning 20 ggml 19 neural-network 19 wasm 18 pytorch 18 tensor 17 scientific-computing 17 webgpu 17 ndarray 17 kernel-fusion 17 high-performance 17 cross-platform 17 concurrency 17 autotune 17 autodiff 17 gpt 16 floneum 15 ml 14 nlp 13 text-summary 12 mistral 8 data 8 agent 8 model 6 transformers 6 anthropic 6 chatbot 6 claude 6 bert 5 ollama 5 gpu 5 candle 5 chat 5 terminal 4 openai-api 4 prompt 4 kawaii 4 api 4 sdk 4 graph 4 qdrant 3 llama2 3 whisper 3 edge 3 python 3 inference 3 ocr 3 llamacpp 3 observability 3 llms 3 gguf 3 proxy 3 logging 3 command-line 3 code 3 text-generation 2 gpt-4 2 autogpt 2 large-language-models 2 llama-cpp 2 gpt4 2 git 2 chatgpt-api 2 stable-diffusion 2 rwkv 2 aigc 2 unix 2 trusted-execution-environment 2 tee 2 privacy-preserving 2 privacy 2 meachine-learning 2 confidential-computing 2 shell 2 huggingface 2 assistant 2 kalosm 2 segment-anything 2 floneum-v3 2 copilot 2 gemini 2 roberta 2 mlops 2 prompt-engineering 2 command-line-tool 2 repl 2 schema 2 aleph-alpha 2 bindings 2 magic 2