Top 3.8% downloads on pypi.org
Top 1.7% dependent repos on pypi.org
Top 2.4% forks on pypi.org
Top 3.4% docker downloads on pypi.org
pypi.org : flexgen
Running large language models like OPT-175B/GPT-3 on a single GPU. Focusing on high-throughput large-batch generation.
Registry
-
Source
- Documentation
- JSON
purl: pkg:pypi/flexgen
Keywords:
deep-learning
, gpt-3
, high-throughput
, large-language-models
, machine-learning
, offloading
, opt
License: Apache-2.0
Latest release: over 1 year ago
First release: about 2 years ago
Dependent repositories: 77
Downloads: 603 last month
Stars: 9,298 on GitHub
Forks: 569 on GitHub
Docker dependents: 37
Docker downloads: 2,659
Total Commits: 94
Committers: 17
Average commits per author: 5.529
Development Distribution Score (DDS): 0.479
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Last synced: 4 days ago