Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org : tilearn-infer
A high-throughput and memory-efficient inference and serving engine for LLMs
Registry
-
Source
- Documentation
- JSON
purl: pkg:pypi/tilearn-infer
Keywords: amd, cuda, gpt, inference, inferentia, llama, llm, llm-serving, llmops, mlops, model-serving, pytorch, rocm, trainium, transformer
License: Apache-2.0
Latest release: about 1 month ago
First release: about 2 months ago
Downloads: 20 last month
Stars: 17,633 on GitHub
Forks: 2,286 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 2 days ago