Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "inference-speed" keyword

Top 6.2% on pypi.org
fastt5 0.1.4
boost inference speed of T5 models by 5x & reduce the model size by 3x using fastT5.
13 versions - Latest release: about 2 years ago - 6 dependent repositories - 1.2 thousand downloads last month - 538 stars on GitHub - 2 maintainers
Related Keywords
T5 1 ONNX 1 onnxruntime 1 NLP 1 transformer 1 quantization 1 generate text 1 summarization 1 translation 1 q&a 1 qg 1 machine learning 1 inference 1 fast inference 1 deep-learning 1 fast 1 fastt5 1 nlp 1 onnx 1 python 1 pytorch 1 quantized-onnx-models 1 question-answering 1 t5 1