Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org "speculative-decoding" keyword
Top 6.4% on pypi.org
16 versions - Latest release: about 2 months ago - 1 dependent package - 4 dependent repositories - 4.72 thousand downloads last month - 1,909 stars on GitHub - 1 maintainer
intel-extension-for-transformers 1.4.1
Repository of Intel® Intel Extension for Transformers16 versions - Latest release: about 2 months ago - 1 dependent package - 4 dependent repositories - 4.72 thousand downloads last month - 1,909 stars on GitHub - 1 maintainer
eagle-llm 1.2.1
Accelerating LLMs by 3x with No Quality Loss3 versions - Latest release: about 2 months ago - 337 downloads last month - 509 stars on GitHub - 1 maintainer
Related Keywords
llm-inference
2
large-language-models
1
xeon
1
streamingllm
1
retrieval
1
rag
1
neurips2023
1
neural-chat-7b
1
neural-chat
1
llm-cpu
1
large-language-model
1
intel-optimized-llamacpp
1
habana
1
gpu
1
gaudi2
1
cpu
1
chatpdf
1
chatbot
1
4-bits
1
tuning strategy
1
quantization-aware training
1
post-training dynamic quantization
1
post-training static quantization
1
auto-tuning
1
quantization
1