Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "inference engine" keyword

deepsparse-ent 1.7.0
An inference runtime offering GPU-class performance on CPUs and APIs to integrate ML into your ap...
13 versions - Latest release: 2 months ago - 2 dependent packages - 280 downloads last month - 2,664 stars on GitHub - 1 maintainer
Top 3.5% on pypi.org
deepsparse 1.7.1
An inference runtime offering GPU-class performance on CPUs and APIs to integrate ML into your ap...
40 versions - Latest release: 2 months ago - 3 dependent packages - 6 dependent repositories - 5.1 thousand downloads last month - 2,664 stars on GitHub - 1 maintainer
Top 6.7% on pypi.org
deepsparse-nightly 1.8.0.20240404
An inference runtime offering GPU-class performance on CPUs and APIs to integrate ML into your ap...
149 versions - Latest release: about 2 months ago - 3 dependent packages - 1 dependent repositories - 2.63 thousand downloads last month - 2,664 stars on GitHub - 1 maintainer
Related Keywords
inference 3 machine learning 3 x86 3 x86_64 3 avx2 3 avx512 3 neural network 3 sparse 3 cpu 3 runtime 3 deepsparse 3 computer vision 3 object detection 3 sparsity 3 computer-vision 3 cpus 3 llm-inference 3 machinelearning 3 nlp 3 object-detection 3 onnx 3 performance 3 pretrained-models 3 pruning 3 quantization 3 sparsification 3