Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "fast inference" keyword

Top 5.7% on pypi.org
simplet5 0.1.4
simpleT5 is built on top of PyTorch-lightning ⚡️ and Transformers 🤗 that lets you quickly train y...
7 versions - Latest release: about 2 years ago - 10 dependent repositories - 4.16 thousand downloads last month - 382 stars on GitHub - 2 maintainers
optimum-transformers 0.2.1
Accelerated nlp pipelines using Transformers, Optimum and ONNX Runtime
3 versions - Latest release: about 2 years ago - 1 dependent repositories - 61 downloads last month - 125 stars on GitHub - 1 maintainer
Top 6.2% on pypi.org
fastt5 0.1.4
boost inference speed of T5 models by 5x & reduce the model size by 3x using fastT5.
13 versions - Latest release: about 2 years ago - 6 dependent repositories - 1.2 thousand downloads last month - 538 stars on GitHub - 2 maintainers
fastgpt 0.0.8
boost inference speed of GPT models in transformers by onnxruntime
8 versions - Latest release: about 1 year ago - 2 dependent repositories - 47 downloads last month - 48 stars on GitHub - 1 maintainer
onnxt5 0.1.8
Blazing fast summarization, translation, text-generation, Q&A and more using T5 in ONNX
11 versions - Latest release: over 3 years ago - 1 dependent repositories - 45 downloads last month - 243 stars on GitHub - 2 maintainers