pypi.org : hami-core
A Python library for batched backend scheduling
Registry
-
Source
- Documentation
- JSON
purl: pkg:pypi/hami-core
Keywords:
deployment
, inference
, llm-serving
, pipeline-parallelism
, pytorch
, ray
, serve
, serving
, tensorrt
, torch2trt
, triton-inference-server
License: Apache-2.0
Latest release: about 1 month ago
First release: about 1 month ago
Downloads: 1,991 last month
Stars: 142 on GitHub
Forks: 12 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: about 1 month ago
Loading...
Readme
Loading...