crates.io : lmonade-runtime
Actor-based runtime for LLM inference orchestration and resource management
Registry
-
Source
- Documentation
- JSON
purl: pkg:cargo/lmonade-runtime
Keywords:
runtime
, async
, actor
, inference
, llm
License: GPL-3.0-or-later
Latest release: 15 days ago
First release: 17 days ago
Downloads: 116 total
Last synced: 15 days ago
Loading...
Readme
Loading...