Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "serving" keyword

Top 1.1% on pypi.org
torch-model-archiver 0.10.0
Torch Model Archiver is used for creating archives of trained neural net models that can be consu...
22 versions - Latest release: about 2 months ago - 6 dependent packages - 251 dependent repositories - 713 thousand downloads last month - 3,975 stars on GitHub - 5 maintainers
Top 2.7% on pypi.org
torch-workflow-archiver 0.2.12
Torch Workflow Archiver is used for creating archives of workflow designed using trained neural n...
16 versions - Latest release: about 2 months ago - 24 dependent repositories - 9.87 thousand downloads last month - 3,975 stars on GitHub - 5 maintainers
Top 1.4% on pypi.org
torchserve 0.10.0
TorchServe is a tool for serving neural net models for inference
22 versions - Latest release: about 2 months ago - 5 dependent packages - 119 dependent repositories - 48.8 thousand downloads last month - 3,975 stars on GitHub - 6 maintainers
mlflow-torchserve 0.1.0
Torch Serve Mlflow Deployment
3 versions - Latest release: over 3 years ago - 1 dependent repositories - 247 downloads last month - 3,975 stars on GitHub - 2 maintainers
torchserve-ag 0.8.2b20230918
TorchServe is a tool for serving neural net models for inference
2 versions - Latest release: 8 months ago - 29 downloads last month - 3,974 stars on GitHub - 1 maintainer
torch-model-archiver-ag 0.6.0b20220624
Torch Model Archiver is used for creating archives of trained neural net models that can be consu...
1 version - Latest release: almost 2 years ago - 11 downloads last month - 3,973 stars on GitHub - 1 maintainer
torch-workflow-archiver-ag 0.2.4b20220624
Torch Workflow Archiver is used for creating archives of workflow designed using trained neural n...
1 version - Latest release: almost 2 years ago - 12 downloads last month - 3,974 stars on GitHub - 1 maintainer
tensorflow-deploy-utils 1.0.0
Utils for managing and communication with TensorFlow Deploy
1 version - Latest release: over 3 years ago - 1 dependent repositories - 33 downloads last month - 2 stars on GitHub - 2 maintainers
Top 2.4% on pypi.org
seldon-core 1.18.1
Seldon Core client and microservice wrapper
50 versions - Latest release: 2 months ago - 4 dependent packages - 164 dependent repositories - 51.7 thousand downloads last month - 4,230 stars on GitHub - 2 maintainers
seldon-core-lilith 1.0.1.dev0
Lilith version Seldon Core client and microservice wrapper
1 version - Latest release: over 2 years ago - 1 dependent repositories - 13 downloads last month - 4,225 stars on GitHub - 2 maintainers
tfserve 0.2.1
Serve TF models simple and easy as an HTTP API server.
5 versions - Latest release: over 5 years ago - 1 dependent repositories - 68 downloads last month - 35 stars on GitHub - 2 maintainers
Top 2.2% on pypi.org
ray-cpp 2.21.0
A subpackage of Ray which provides the Ray C++ API.
52 versions - Latest release: 1 day ago - 2 dependent packages - 4 dependent repositories - 44.9 thousand downloads last month - 30,888 stars on GitHub - 29 maintainers
Top 0.2% on pypi.org
ray 2.21.0
Ray provides a simple, universal API for building distributed applications.
102 versions - Latest release: 1 day ago - 234 dependent packages - 3,641 dependent repositories - 4.58 million downloads last month - 30,888 stars on GitHub - 33 maintainers
qwak-core 0.4.5
Qwak Core contains the necessary objects and communication tools for using the Qwak Platform
536 versions - Latest release: 2 days ago - 2 dependent packages - 14.8 thousand downloads last month - 2 maintainers
friendli-client 1.3.4
Client of Friendli Suite.
13 versions - Latest release: about 1 month ago - 3.66 thousand downloads last month - 33 stars on GitHub - 2 maintainers
periflow-client 0.2.2
Client of PeriFlow, the fastest generative AI serving available.
17 versions - Latest release: about 1 month ago - 151 downloads last month - 33 stars on GitHub - 1 maintainer
django-explorer 0.3.0
Serve local direcotry listing from django
2 versions - Latest release: almost 3 years ago - 1 dependent repositories - 35 downloads last month - 2 maintainers
Top 9.2% on pypi.org
paddle-serving-server 0.9.0
Paddle Serving Package for saved model with PaddlePaddle
20 versions - Latest release: almost 2 years ago - 1 dependent repositories - 473 downloads last month - 877 stars on GitHub - 2 maintainers
Top 5.2% on pypi.org
paddle-serving-client 0.9.0
Paddle Serving Package for saved model with PaddlePaddle
21 versions - Latest release: almost 2 years ago - 33 dependent repositories - 689 downloads last month - 877 stars on GitHub - 2 maintainers
Top 5.7% on pypi.org
paddle-serving-server-gpu 0.3.1
Paddle Serving Package for saved model with PaddlePaddle
47 versions - Latest release: almost 4 years ago - 31 dependent repositories - 542 downloads last month - 877 stars on GitHub - 2 maintainers
Top 7.1% on pypi.org
bert-serving 0.0.1
package for paddle serving with bert
1 version - Latest release: over 4 years ago - 6 dependent repositories - 248 downloads last month - 877 stars on GitHub - 2 maintainers
Top 5.6% on pypi.org
paddle-serving-app 0.9.0
Paddle Serving Package for saved model with PaddlePaddle
17 versions - Latest release: almost 2 years ago - 31 dependent repositories - 449 downloads last month - 877 stars on GitHub - 1 maintainer
bert-service 0.3.7
client package for bert serving
2 versions - Latest release: over 4 years ago - 1 dependent repositories - 26 downloads last month - 877 stars on GitHub - 2 maintainers
paddle-gpu-serving 0.8.3
package for paddle serving with bert
6 versions - Latest release: over 3 years ago - 1 dependent repositories - 35 downloads last month - 877 stars on GitHub - 2 maintainers
paddle-serving-server-xpu 0.9.0.post2
Paddle Serving Package for saved model with PaddlePaddle
3 versions - Latest release: almost 2 years ago - 1 dependent repositories - 11 downloads last month - 874 stars on GitHub - 1 maintainer
qwak-inference 0.1.17
Qwak Inference is a Python library for running predictions again Qwak Models.
20 versions - Latest release: 4 days ago - 1 dependent package - 5.48 thousand downloads last month - 2 maintainers
Top 9.1% on pypi.org
kallithea 0.7.0
Kallithea is a fast and powerful management tool for Mercurial and Git with a built in push/pull ...
27 versions - Latest release: almost 3 years ago - 6 dependent repositories - 209 downloads last month - 3 maintainers
delta-nlp 0.3.2
DELTA is a deep learning based natural language and speech processing platform.
3 versions - Latest release: about 4 years ago - 1 dependent repositories - 2 downloads last month - 1,583 stars on GitHub - 2 maintainers
jina-core 0.0.1
Jina is geared towards building search-as-a-service systems for any kind of data in just minutes.
2 versions - Latest release: almost 3 years ago - 1 dependent repositories - 15 downloads last month - 19,512 stars on GitHub - 1 maintainer
fine-tuner 0.0.0
Jina is the cloud-native neural search framework for any kind of data
1 version - Latest release: over 2 years ago - 1 dependent repositories - 20 downloads last month - 19,631 stars on GitHub - 1 maintainer
streamlit-jina 0.1.8
Streamlit component for Jina neural search
7 versions - Latest release: about 3 years ago - 3 dependent repositories - 27 downloads last month - 34 stars on GitHub - 2 maintainers
jarray 0.0.0
Jina is the cloud-native neural search framework for any kind of data
1 version - Latest release: over 2 years ago - 1 dependent repositories - 72 downloads last month - 19,512 stars on GitHub - 1 maintainer
rhodecode 2.2.6
RhodeCode is a fast and powerful management tool for Mercurial and GIT with a built in push/pull ...
39 versions - Latest release: over 9 years ago - 1 dependent repositories - 146 downloads last month - 1 maintainer
pytorch-search 0.6.8
Jina is the cloud-native neural search solution powered by the state-of-the-art AI and deep learning
2 versions - Latest release: over 3 years ago - 1 dependent repositories - 17 downloads last month - 19,631 stars on GitHub - 2 maintainers
ai-serving-server 0.0.0
Mapping a variable-length sentence to a fixed-length vector using BERT model (Server)
1 version - Latest release: about 2 years ago - 38 downloads last month - 12,060 stars on GitHub - 1 maintainer
gina 0.6.3
Jina is the cloud-native neural search solution powered by the state-of-the-art AI and deep learning
2 versions - Latest release: over 3 years ago - 1 dependent repositories - 19 downloads last month - 19,631 stars on GitHub - 2 maintainers
metasporecli 0.1.3
metasporecli: Command-line Interface for MetaSpore Flow Management
4 versions - Latest release: over 1 year ago - 1 dependent repositories - 17 downloads last month - 629 stars on GitHub - 2 maintainers
metaspore 1.1.0
Metaspore: A Unified End-to-end Machine Intelligence Platform
3 versions - Latest release: over 1 year ago - 10 downloads last month - 626 stars on GitHub - 4 maintainers
tf-search 0.6.6
Jina is the cloud-native neural search solution powered by the state-of-the-art AI and deep learning
3 versions - Latest release: over 3 years ago - 1 dependent repositories - 23 downloads last month - 19,631 stars on GitHub - 2 maintainers
metasporeflow 0.1.3
metasporeflow: MetaSpore Flow Management
4 versions - Latest release: over 1 year ago - 1 dependent package - 1 dependent repositories - 16 downloads last month - 627 stars on GitHub - 4 maintainers
Top 1.7% on pypi.org
bert-serving-server 1.10.0
Mapping a variable-length sentence to a fixed-length vector using BERT model (Server)
57 versions - Latest release: over 4 years ago - 2 dependent packages - 143 dependent repositories - 6.75 thousand downloads last month - 12,060 stars on GitHub - 1 maintainer
Top 1.6% on pypi.org
bert-serving-client 1.10.0
Mapping a variable-length sentence to a fixed-length vector using BERT model (Client)
56 versions - Latest release: over 4 years ago - 2 dependent packages - 169 dependent repositories - 9.95 thousand downloads last month - 12,060 stars on GitHub - 1 maintainer
Top 0.6% on pypi.org
tensorflow-serving-api 2.16.1
TensorFlow Serving Python API.
110 versions - Latest release: about 2 months ago - 9 dependent packages - 1,378 dependent repositories - 10.3 million downloads last month - 3 maintainers
tensorflow-search 0.6.8
Jina is the cloud-native neural search solution powered by the state-of-the-art AI and deep learning
2 versions - Latest release: over 3 years ago - 1 dependent repositories - 23 downloads last month - 19,631 stars on GitHub - 2 maintainers
litserve 0.1.0
Lightweight AI server.
4 versions - Latest release: 17 days ago - 2.82 thousand downloads last month - 51 stars on GitHub - 4 maintainers
searchai 0.0.1
Jina is geared towards building search-as-a-service systems for any kind of data in just minutes.
1 version - Latest release: almost 3 years ago - 1 dependent repositories - 18 downloads last month - 19,631 stars on GitHub - 1 maintainer
serving_template 0.1.1
Model Serving Project Template
2 versions - Latest release: over 3 years ago - 8 downloads last month - 0 stars on GitHub - 2 maintainers
jinad 0.0.7
Jinad is the daemon tool for running Jina on remote machines. Jina is the cloud-native neural sea...
7 versions - Latest release: over 3 years ago - 1 dependent repositories - 28 downloads last month - 3 stars on GitHub - 2 maintainers
jdarray 0.0.0
Jina is the cloud-native neural search framework for any kind of data
1 version - Latest release: over 2 years ago - 1 dependent repositories - 10 downloads last month - 19,512 stars on GitHub - 1 maintainer
embedding-as-service 3.1.2
embedding-as-service: one-stop solution to encode sentence to vectors using various embedding met...
32 versions - Latest release: over 1 year ago - 1 dependent repositories - 423 downloads last month - 199 stars on GitHub - 1 maintainer
embedding-as-service-client 1.0.0
embedding-as-service: one-stop solution to encode sentence to vectors using various embedding met...
1 version - Latest release: over 4 years ago - 2 dependent repositories - 16 downloads last month - 199 stars on GitHub - 1 maintainer
neural-search 0.6.3
Jina is the cloud-native neural search solution powered by the state-of-the-art AI and deep learning
3 versions - Latest release: over 3 years ago - 1 dependent repositories - 27 downloads last month - 19,631 stars on GitHub - 2 maintainers
jina-search 0.6.3
Jina is the cloud-native neural search solution powered by the state-of-the-art AI and deep learning
3 versions - Latest release: over 3 years ago - 1 dependent repositories - 23 downloads last month - 19,631 stars on GitHub - 2 maintainers
serveit 0.0.9
Machine learning prediction serving
45 versions - Latest release: over 5 years ago - 2 dependent repositories - 361 downloads last month - 32 stars on GitHub - 2 maintainers
generative 0.0.0
Build cross-modal and multi-modal applications on the cloud
1 version - Latest release: almost 2 years ago - 1 dependent repositories - 115 downloads last month - 19,512 stars on GitHub - 1 maintainer
vec-search 0.6.3
Jina is the cloud-native neural search solution powered by the state-of-the-art AI and deep learning
3 versions - Latest release: over 3 years ago - 1 dependent repositories - 21 downloads last month - 19,631 stars on GitHub - 2 maintainers
elastic-neural-search 0.6.3
Jina is the cloud-native neural search solution powered by the state-of-the-art AI and deep learning
3 versions - Latest release: over 3 years ago - 1 dependent repositories - 5 downloads last month - 19,631 stars on GitHub - 2 maintainers
fine-tune 0.0.0
Jina is the cloud-native neural search framework for any kind of data
1 version - Latest release: over 2 years ago - 1 dependent repositories - 26 downloads last month - 19,631 stars on GitHub - 1 maintainer
periflow-sdk 0.1.2
PeriFlow SDK
4 versions - Latest release: about 1 year ago - 1 dependent repositories - 10 downloads last month - 18 stars on GitHub - 1 maintainer
tfweb 0.4.11
Server for exposing tensorflow models though HTTP JSON API
14 versions - Latest release: almost 5 years ago - 1 dependent repositories - 37 downloads last month - 11 stars on GitHub - 2 maintainers
ai-serving-client 0.0.0
Mapping a variable-length sentence to a fixed-length vector using BERT model (Client)
1 version - Latest release: about 2 years ago - 1 dependent repositories - 24 downloads last month - 12,060 stars on GitHub - 2 maintainers
gnes 0.0.47
GNES is Generic Neural Elastic Search, a cloud-native semantic search system based on deep neural...
43 versions - Latest release: over 4 years ago - 1 dependent repositories - 449 downloads last month - 1,257 stars on GitHub - 2 maintainers
smlp 1.1.0
a shallow machine learning toolkit for text PreProcessing
1 version - Latest release: almost 4 years ago - 1 dependent repositories - 14 downloads last month - 2 maintainers
pinference 0.1.0b1
Aims to be the Simplest Machine Learning Model Inference Server
1 version - Latest release: about 2 years ago - 1 dependent repositories - 13 downloads last month - 557 stars on GitHub - 1 maintainer
pinferencia 0.2.1
Aims to be the Simplest Machine Learning Model Inference Server
15 versions - Latest release: over 1 year ago - 1 dependent repositories - 110 downloads last month - 557 stars on GitHub - 1 maintainer
iog-sdk 0.0.1
IOG SDK - Internet of GPUs - IO.net
1 version - Latest release: 10 days ago - 2 maintainers
cmon.pw 0.42.6
Build multimodal AI services via cloud native technologies · Neural Search · Generative AI · MLOps
1 version - Latest release: 11 months ago - 9 downloads last month - 2 maintainers
Top 8.6% on pypi.org
bodywork 3.0.12
ML pipeline orchestration and model deployments on Kubernetes, made really easy.
60 versions - Latest release: almost 2 years ago - 6 dependent repositories - 367 downloads last month - 431 stars on GitHub - 2 maintainers
Top 6.7% on pypi.org
secretflow-ray 2.2.0
Ray provides a simple, universal API for building distributed applications.
3 versions - Latest release: over 1 year ago - 2 dependent packages - 1 dependent repositories - 657 downloads last month - 30,478 stars on GitHub - 1 maintainer
happy-vllm 1.1.1
happy_vllm is a REST API for vLLM, production ready
4 versions - Latest release: 21 days ago - 252 downloads last month - 18 stars on GitHub - 2 maintainers
inferout 0.0.0a5
Distributed Scale Out Framework for ML models serving/inference
6 versions - Latest release: over 2 years ago - 1 dependent repositories - 33 downloads last month - 4 stars on GitHub - 2 maintainers
Top 8.5% on pypi.org
simple-tensorflow-serving 0.8.2
The simpler and easy-to-use serving service for TensorFlow models
35 versions - Latest release: over 3 years ago - 2 dependent repositories - 12 downloads last month - 757 stars on GitHub - 2 maintainers
Top 0.7% on pypi.org
jina 3.23.3
Multimodal AI services & pipelines with cloud-native stack: gRPC, Kubernetes, Docker, OpenTelemet...
2,450 versions - Latest release: 3 months ago - 14 dependent packages - 687 dependent repositories - 139 thousand downloads last month - 19,512 stars on GitHub - 1 maintainer
cmon-ai 0.42.6
Build multimodal AI services via cloud native technologies · Neural Search · Generative AI · MLOps
4 versions - Latest release: 11 months ago - 7 downloads last month - 2 maintainers
mldrop-client 0.1.1
Python client for MLDrop by Scattering AI
2 versions - Latest release: about 1 year ago - 9 downloads last month - 3 stars on GitHub - 2 maintainers
Top 2.8% on pypi.org
ovmsclient 2023.1
Python client for OpenVINO Model Server
6 versions - Latest release: 8 months ago - 5 dependent packages - 24 dependent repositories - 17.2 thousand downloads last month - 635 stars on GitHub - 1 maintainer
Top 6.6% on pypi.org
bert-base 0.0.9
Use Google's BERT for Chinese natural language processing tasks such as named entity recognition ...
5 versions - Latest release: about 5 years ago - 7 dependent repositories - 272 downloads last month - 4,543 stars on GitHub - 2 maintainers
toolkit-bert-ner 1.0.2
Use Google's BERT for Chinese natural language processing tasks such as named entity recognition ...
1 version - Latest release: over 4 years ago - 1 dependent repositories - 11 downloads last month - 4,543 stars on GitHub - 2 maintainers
hydro-integrations 2.3.0
HydroSDK integrations
4 versions - Latest release: almost 4 years ago - 1 dependent repositories - 23 downloads last month - 2 maintainers
fdclient 3.0.5
fastDeploy python client
7 versions - Latest release: about 2 months ago - 58 downloads last month - 90 stars on GitHub - 2 maintainers
fastdeploy 3.0.13
Deploy DL/ ML inference pipelines with minimal extra code.
69 versions - Latest release: 18 days ago - 1 dependent repositories - 650 downloads last month - 90 stars on GitHub - 2 maintainers
kedro-serving 0.0.1
A kedro plugin to serve kedro pipelines
1 version - Latest release: over 2 years ago - 1 dependent repositories - 9 downloads last month - 13 stars on GitHub - 1 maintainer
caicloud.tensorflow 2.1.0
Caicloud TensorFlow as a Service (TaaS) dev environment
6 versions - Latest release: almost 7 years ago - 12 downloads last month - 2 maintainers
Top 9.8% on pypi.org
haupt 2.1.8
Lineage metadata API, artifacts streams, sandbox, ML-API, and spaces for Polyaxon.
125 versions - Latest release: 20 days ago - 1 dependent package - 947 downloads last month - 452 stars on GitHub - 2 maintainers
fastdeploy-gpu-python 0.1.0
FastDeploy is a toolkit to deploy deeplearning models.
1 version - Latest release: over 1 year ago - 1 dependent repositories - 185 downloads last month - 2,695 stars on GitHub - 1 maintainer
fd-auto-compress 0.0.1
A toolkit for model auto compression of FastDeploy.
2 versions - Latest release: over 1 year ago - 1 dependent repositories - 14 downloads last month - 2,695 stars on GitHub - 1 maintainer
fastdeploy-py3 0.1.0
FastDeploy is a toolkit to deploy deeplearning models.
1 version - Latest release: almost 2 years ago - 21 downloads last month - 2,695 stars on GitHub - 1 maintainer
Top 8.7% on pypi.org
fastdeploy-python 1.0.7
Deploy Kit Tool For Deeplearning models.
18 versions - Latest release: 12 months ago - 1 dependent repositories - 1.06 thousand downloads last month - 2,695 stars on GitHub - 2 maintainers
fastdeploy-llm 0.0.8
FastDeploy for Large Language Model
4 versions - Latest release: 7 months ago - 22 downloads last month - 2,695 stars on GitHub - 1 maintainer
Top 6.8% on pypi.org
evadb 0.3.9
EvaDB AI-Relational Database System
44 versions - Latest release: 6 months ago - 1 dependent repositories - 9.07 thousand downloads last month - 2,565 stars on GitHub - 1 maintainer
Top 7.6% on pypi.org
torchserve-nightly 2024.4.17
TorchServe is a tool for serving neural net models for inference
774 versions - Latest release: 23 days ago - 1 dependent repositories - 5.34 thousand downloads last month - 3,787 stars on GitHub - 2 maintainers
Top 7.7% on pypi.org
clearml-serving 1.3.0
clearml-serving - Model-Serving Orchestration and Repository Solution
9 versions - Latest release: about 1 year ago - 3 dependent repositories - 1.37 thousand downloads last month - 124 stars on GitHub - 1 maintainer
lineagemd 0.0.0
Lineage metadata for ML/AI/Data.
1 version - Latest release: over 1 year ago - 12 downloads last month - 452 stars on GitHub - 2 maintainers
hauptai 0.0.0
Haupt ai.
1 version - Latest release: over 1 year ago - 5 downloads last month - 452 stars on GitHub - 1 maintainer
Top 7.6% on pypi.org
torch-workflow-archiver-nightly 2024.4.13
Torch Workflow Archiver is used for creating archives of workflow designed using trained neural n...
756 versions - Latest release: 27 days ago - 1 dependent repositories - 5.82 thousand downloads last month - 3,787 stars on GitHub - 2 maintainers
marie-ai 3.0.29
Python library to Integrate AI-powered features into your applications
7 versions - Latest release: 2 months ago - 54 downloads last month - 40 stars on GitHub - 1 maintainer
fangyu-pypitest 0.8.0.dev4
A system for parallel and distributed Python that unifies the ML ecosystem.
1 version - Latest release: over 4 years ago - 1 dependent repositories - 16 downloads last month - 30,478 stars on GitHub - 1 maintainer
sdap-os 0.1.2
Demo of usage of object storage for SDAP
3 versions - Latest release: almost 2 years ago - 1 dependent repositories - 13 downloads last month - 30,478 stars on GitHub - 2 maintainers
myray 0.1.1
my ray desc
2 versions - Latest release: over 3 years ago - 1 dependent repositories - 8 downloads last month - 30,478 stars on GitHub - 2 maintainers
ray-for-mars 1.12.1
Ray provides a simple, universal API for building distributed applications.
2 versions - Latest release: almost 2 years ago - 1 dependent repositories - 22 downloads last month - 30,478 stars on GitHub - 1 maintainer
Related Keywords
deep-learning 67 machine-learning 50 mlops 45 docker 42 kubernetes 35 pytorch 35 encoding 35 tensorflow 34 embedding 34 python 28 pipeline 25 neural-search 24 neural-network 23 elastic 22 container 21 audio 21 video 21 image 21 index 21 search 21 cloud-native 21 deployment 20 query 20 ai 20 machine 20 gpu 19 learning 19 generative-ai 19 jina 18 llmops 18 optimization 18 multimodal 18 framework 18 grpc 18 fastapi 17 orchestration 17 microservice 17 prometheus 16 nlp 16 opentelemetry 16 jaeger 16 cncf 16 data-science 14 sentence 12 bert 12 Inference 11 llm-serving 11 AI 10 cpu 10 metrics 10 inference 9 TorchServe 9 dag 9 model-serving 9 onnx 9 semantic 9 Serving 9 Deep 9 Learning 9 distributed 9 reinforcement-learning 9 paddle-serving 8 micro-service 8 microservice-toolkit 8 online-service 8 paddle 8 prediction 8 predictor 8 rpc-service 8 parallel 8 ray 8 automl 7 object-detection 7 ml 7 model-selection 7 hyperparameter-optimization 7 rllib 7 java 7 inference-server 7 hyperparameter-search 7 stable-diffusion 7 sentence-encoding 6 bert-as-service 6 openvino 6 Torch 6 Archive 6 Archiver 6 Server 6 llm 5 tensorflow-serving 5 android 5 graphcore 5 intel 5 jetson 5 kunlun 5 onnxruntime 5 picodet 5 rockchip 5 tensorrt 5 model 5