pypi.org : kvq
More for Keys, Less for Values: Adaptive KV Cache Quantization ☝️🔑👇🔢
Registry
-
Source
- Homepage
- Documentation
- JSON
purl: pkg:pypi/kvq
Keywords:
Large Language Models
, Cache
, Quantization
, Compression
, Optimization
License: MIT
Latest release: about 1 month ago
First release: about 2 months ago
Downloads: 422 last month
Stars: 0 on GitHub
Forks: 0 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 24 days ago
Loading...
Readme
Loading...