crates.io : flyllm
A rust library for unifying LLM backends as an abstraction layer with load balancing.
Registry
-
Source
- Documentation
- JSON
purl: pkg:cargo/flyllm
Keywords:
ai
, anthropic
, llm
, load-balancing
, openai
, load-balancer
, routing
, rust
License: MIT
Latest release: about 2 months ago
First release: 3 months ago
Downloads: 2,348 total
Stars: 12 on GitHub
Forks: 0 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 15 days ago
Loading...
Readme
Loading...