pypi.org : batch-inference
Batch Inference
Registry
-
Source
- Homepage
- Documentation
- JSON
purl: pkg:pypi/batch-inference
Keywords:
deep-learning
, dynamic-batching
, gpt
, inference
, llm
, performance-optimization
, python
License: MIT
Latest release: over 2 years ago
First release: over 2 years ago
Downloads: 135 last month
Stars: 103 on GitHub
Forks: 3 on GitHub
Total Commits: 32
Committers: 7
Average commits per author: 4.571
Development Distribution Score (DDS): 0.563
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Last synced: 9 days ago