Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "fastertransformer" keyword

View the packages on the pypi.org package registry that are tagged with the "fastertransformer" keyword.

fastertransformer 5.0.0.113
fastertransformer: fastertransformer tf op
4 versions - Latest release: over 3 years ago - 24 downloads last month - 6,153 stars on GitHub - 1 maintainer
lazyllm-lmdeploy 0.7.1rc0
A toolset for compressing, deploying and serving LLM
1 version - Latest release: 8 months ago - 36 downloads last month - 6,298 stars on GitHub - 1 maintainer
Top 6.0% on pypi.org
lmdeploy 0.10.2
A toolset for compressing, deploying and serving LLM
58 versions - Latest release: 5 days ago - 1 dependent package - 2 dependent repositories - 52.4 thousand downloads last month - 7,202 stars on GitHub - 1 maintainer
llmdeploy 0.0.1
triton inference service of llama
1 version - Latest release: over 2 years ago - 8 downloads last month - 7,085 stars on GitHub - 1 maintainer
Related Keywords
codellama 3 cuda-kernels 3 deepspeed 3 internlm 3 llama 3 llama2 3 llama3 3 llm 3 llm-inference 3 turbomind 3 bert 1 gpt 1 pytorch 1 transformer 1