Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "CausalLM" keyword

fastgpt 0.0.8
boost inference speed of GPT models in transformers by onnxruntime
8 versions - Latest release: about 1 year ago - 2 dependent repositories - 47 downloads last month - 48 stars on GitHub - 1 maintainer
Top 6.0% on pypi.org
transformers-stream-generator 0.0.5 💰
This is a text generation method which returns a generator, streaming out each token in real-time...
5 versions - Latest release: 2 months ago - 8 dependent packages - 2 dependent repositories - 65.3 thousand downloads last month - 74 stars on GitHub - 2 maintainers
Related Keywords
transformers 2 gpt 2 machine learning 2 qg 2 q&a 2 translation 2 summarization 2 text generation 2 NLP 2 GPT 2 quantization 1 model hubtransformer 1 onnxruntime 1 fast inference 1 generate 1 ONNX 1 stream 1 model hub 1 transformer 1 stream-generator 1 text-generation 1