npmjs.org : llm-load-balancer
A small service package allowing to perform load balancing of LLM prompts between models, regions and model hosting platforms
Registry
-
Source
- Homepage
- JSON
purl: pkg:npm/llm-load-balancer
Keywords:
LLM
, load balancing
, bedrock
, vertex
, AI
, AWS
, GCP
License: MIT
Latest release: 8 months ago
First release: 9 months ago
Downloads: 4 last month
Stars: 1 on GitHub
Forks: 0 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 20 days ago
Loading...
Readme
Loading...