Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org "inference" keyword
skeem 0.1.0
Infer SQL DDL statements from tabular data1 version - Latest release: about 1 year ago - 14 downloads last month - 3 stars on GitHub - 2 maintainers
Top 8.1% on pypi.org
153 versions - Latest release: about 4 hours ago - 1 dependent package - 1 dependent repositories - 1.07 thousand downloads last month - 1,976 stars on GitHub - 1 maintainer
sparseml-nightly 1.8.0.20240509
Libraries for applying sparsification recipes to neural networks with a few lines of code, enabli...153 versions - Latest release: about 4 hours ago - 1 dependent package - 1 dependent repositories - 1.07 thousand downloads last month - 1,976 stars on GitHub - 1 maintainer
Top 7.1% on pypi.org
11 versions - Latest release: over 2 years ago - 10 dependent repositories - 192 downloads last month - 1,050 stars on GitHub - 1 maintainer
causality 0.0.10
Tools for causal inference11 versions - Latest release: over 2 years ago - 10 dependent repositories - 192 downloads last month - 1,050 stars on GitHub - 1 maintainer
vllm-xft 0.3.3.0
A high-throughput and memory-efficient inference and serving engine for LLMs1 version - Latest release: about 1 month ago - 25 downloads last month - 17,633 stars on GitHub - 2 maintainers
llm-swarm 0.1.1
A high-throughput and memory-efficient inference and serving engine for LLMs2 versions - Latest release: 2 months ago - 79 downloads last month - 17,633 stars on GitHub - 2 maintainers
vllm-acc 0.4.1
A high-throughput and memory-efficient inference and serving engine for LLMs7 versions - Latest release: 6 days ago - 1.15 thousand downloads last month - 17,633 stars on GitHub - 2 maintainers
Top 3.4% on pypi.org
26 versions - Latest release: 5 days ago - 7 dependent packages - 5 dependent repositories - 509 thousand downloads last month - 17,633 stars on GitHub - 4 maintainers
vllm 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs26 versions - Latest release: 5 days ago - 7 dependent packages - 5 dependent repositories - 509 thousand downloads last month - 17,633 stars on GitHub - 4 maintainers
nextai-vllm 0.0.7
A high-throughput and memory-efficient inference and serving engine for LLMs6 versions - Latest release: 15 days ago - 149 downloads last month - 17,633 stars on GitHub - 2 maintainers
vllm-online 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs2 versions - Latest release: 11 days ago - 262 downloads last month - 17,633 stars on GitHub - 2 maintainers
tilearn-test01 0.1
A high-throughput and memory-efficient inference and serving engine for LLMs1 version - Latest release: about 1 month ago - 25 downloads last month - 17,633 stars on GitHub - 2 maintainers
vllm-consul 0.2.1
A high-throughput and memory-efficient inference and serving engine for LLMs5 versions - Latest release: 7 months ago - 39 downloads last month - 12,665 stars on GitHub - 2 maintainers
superlaser 0.0.6
An MLOps library for LLM deployment w/ the vLLM engine on RunPod's infra.6 versions - Latest release: 2 months ago - 80 downloads last month - 17,633 stars on GitHub - 2 maintainers
hive-vllm 0.0.1
a1 version - Latest release: 2 months ago - 7 downloads last month - 17,633 stars on GitHub - 1 maintainer
tilearn-infer 0.3.3
A high-throughput and memory-efficient inference and serving engine for LLMs3 versions - Latest release: 18 days ago - 255 downloads last month - 17,633 stars on GitHub - 2 maintainers
llm_atc 0.1.7
Tools for fine tuning and serving LLMs6 versions - Latest release: 5 months ago - 39 downloads last month - 17,633 stars on GitHub - 2 maintainers
flowmc 0.3.3
Normalizing flow exhanced sampler in jax22 versions - Latest release: 2 days ago - 3.82 thousand downloads last month - 173 stars on GitHub - 2 maintainers
Top 5.2% on pypi.org
17 versions - Latest release: 2 months ago - 3 dependent repositories - 5.72 thousand downloads last month - 1,661 stars on GitHub - 2 maintainers
deepspeed-mii 0.2.3
deepspeed mii17 versions - Latest release: 2 months ago - 3 dependent repositories - 5.72 thousand downloads last month - 1,661 stars on GitHub - 2 maintainers
nn-meter 2.0
nn-Meter is a novel and efficient system to accurately predict the inference latency of DNN model...3 versions - Latest release: almost 2 years ago - 1 dependent repositories - 71 downloads last month - 316 stars on GitHub - 2 maintainers
openvino-nightly 2024.2.0.dev20240509
OpenVINO(TM) Runtime115 versions - Latest release: about 9 hours ago - 1 dependent repositories - 34.3 thousand downloads last month - 5,906 stars on GitHub - 2 maintainers
lkhandmapping 0.1.2
Deply handtracking model with just few lines of code.5 versions - Latest release: over 1 year ago - 1 dependent repositories - 34 downloads last month - 25,580 stars on GitHub - 2 maintainers
Top 7.0% on pypi.org
11 versions - Latest release: 9 months ago - 1 dependent repositories - 12.4 thousand downloads last month - 24,200 stars on GitHub - 1 maintainer
mediapipe-model-maker 0.2.1
MediaPipe Model Maker is a simple, low-code solution for customizing on-device ML models11 versions - Latest release: 9 months ago - 1 dependent repositories - 12.4 thousand downloads last month - 24,200 stars on GitHub - 1 maintainer
landmark-detection 0.1.1
This is for detect coordinates parts of the body3 versions - Latest release: almost 3 years ago - 1 dependent repositories - 87 downloads last month - 25,580 stars on GitHub - 1 maintainer
mediapipeopenvino 0.0.2
Towards a subset reimplmention of Mediapipe with OpenVINO tool.2 versions - Latest release: about 2 years ago - 1 dependent repositories - 135 downloads last month - 25,580 stars on GitHub - 1 maintainer
mediapipe-nightly 0.0.0
MediaPipe is the simplest way for researchers and developers to build world-class ML solutions an...107 versions - Latest release: 6 months ago - 5.03 thousand downloads last month - 24,200 stars on GitHub - 2 maintainers
astypes 0.2.6
Infer types for AST nodes.8 versions - Latest release: about 1 year ago - 1 dependent package - 198 downloads last month - 6 stars on GitHub - 2 maintainers
typeql-grammar 2.28.0
TypeQL Grammar for Python20 versions - Latest release: 28 days ago - 1 dependent repositories - 234 downloads last month - 211 stars on GitHub - 4 maintainers
Top 3.1% on pypi.org
1,113 versions - Latest release: 11 months ago - 1 dependent package - 12 dependent repositories - 73 thousand downloads last month - 976 stars on GitHub - 1 maintainer
multi-model-server 1.1.11
Multi Model Server is a tool for serving neural net models for inference1,113 versions - Latest release: 11 months ago - 1 dependent package - 12 dependent repositories - 73 thousand downloads last month - 976 stars on GitHub - 1 maintainer
Top 1.4% on pypi.org
63 versions - Latest release: about 15 hours ago - 51 dependent packages - 715 dependent repositories - 1.12 million downloads last month - 2,003 stars on GitHub - 8 maintainers
optimum 1.19.2
Optimum Library is an extension of the Hugging Face Transformers library, providing a framework t...63 versions - Latest release: about 15 hours ago - 51 dependent packages - 715 dependent repositories - 1.12 million downloads last month - 2,003 stars on GitHub - 8 maintainers
ohmlr 0.0.17
One-hot multinomial logisitc regression7 versions - Latest release: over 5 years ago - 1 dependent repositories - 28 downloads last month - 0 stars on GitHub - 2 maintainers
Top 8.4% on pypi.org
12 versions - Latest release: about 2 years ago - 2 dependent repositories - 160 downloads last month - 706 stars on GitHub - 1 maintainer
yolort 0.6.3 💰
yolort is a runtime stack for object detection on specialized accelerators.12 versions - Latest release: about 2 years ago - 2 dependent repositories - 160 downloads last month - 706 stars on GitHub - 1 maintainer
whisper.cpp-cli 0.0.3 💰
A Python package for the whisper.cpp CLI.4 versions - Latest release: 9 days ago - 2.9 thousand downloads last month - 31,566 stars on GitHub - 1 maintainer
whisper-cpp-python 0.2.0 💰
A Python wrapper for whisper.cpp12 versions - Latest release: 12 months ago - 1 dependent package - 1 dependent repositories - 359 downloads last month - 31,566 stars on GitHub - 2 maintainers
pasp-plp 0.0.4
Probabilistic Answer Set Programming15 versions - Latest release: 11 months ago - 48 downloads last month - 15 stars on GitHub - 1 maintainer
everai 0.1.47
Client library to manage everai infrastructure24 versions - Latest release: about 19 hours ago - 1.17 thousand downloads last month - 2 maintainers
Top 6.1% on pypi.org
14 versions - Latest release: 7 months ago - 3 dependent repositories - 2.1 thousand downloads last month - 663 stars on GitHub - 2 maintainers
causallib 0.9.6
A Python package for flexible and modular causal inference modeling14 versions - Latest release: 7 months ago - 3 dependent repositories - 2.1 thousand downloads last month - 663 stars on GitHub - 2 maintainers
Top 5.7% on pypi.org
7 versions - Latest release: about 2 years ago - 10 dependent repositories - 4.16 thousand downloads last month - 382 stars on GitHub - 2 maintainers
simplet5 0.1.4
simpleT5 is built on top of PyTorch-lightning ⚡️ and Transformers 🤗 that lets you quickly train y...7 versions - Latest release: about 2 years ago - 10 dependent repositories - 4.16 thousand downloads last month - 382 stars on GitHub - 2 maintainers
ppi-python 0.2.2
Prediction-Powered Inference7 versions - Latest release: 2 months ago - 1.28 thousand downloads last month - 163 stars on GitHub - 2 maintainers
pyridge 0.1.0
Efficient grid-based evaluation of probability distributions1 version - Latest release: 3 days ago - 172 downloads last month - 0 stars on GitHub - 2 maintainers
whisper-ane 0.1.0
ANE optimised adaptation of Whisper for optimised inference1 version - Latest release: about 1 year ago - 20 downloads last month - 2,479 stars on GitHub - 2 maintainers
Top 3.5% on pypi.org
60 versions - Latest release: 29 days ago - 10 dependent packages - 33 dependent repositories - 60.8 thousand downloads last month - 139 stars on GitHub - 11 maintainers
woodwork 0.30.0
a data typing library for machine learning60 versions - Latest release: 29 days ago - 10 dependent packages - 33 dependent repositories - 60.8 thousand downloads last month - 139 stars on GitHub - 11 maintainers
Top 8.3% on pypi.org
3 versions - Latest release: 10 months ago - 3 dependent packages - 1 dependent repositories - 31.2 thousand downloads last month - 96 stars on GitHub - 1 maintainer
qonnx 0.3.0
Frontend and utilities for QONNX3 versions - Latest release: 10 months ago - 3 dependent packages - 1 dependent repositories - 31.2 thousand downloads last month - 96 stars on GitHub - 1 maintainer
Top 0.5% on pypi.org
41 versions - Latest release: 1 day ago - 99 dependent packages - 2,464 dependent repositories - 1.08 million downloads last month - 25,567 stars on GitHub - 2 maintainers
mediapipe 0.10.14
MediaPipe is the simplest way for researchers and developers to build world-class ML solutions an...41 versions - Latest release: 1 day ago - 99 dependent packages - 2,464 dependent repositories - 1.08 million downloads last month - 25,567 stars on GitHub - 2 maintainers
infer-camembert 0.2.0
Python implementation for text classification inference with CamemBERT fine-tuned models3 versions - Latest release: 3 months ago - 29 downloads last month - 2 stars on GitHub - 2 maintainers
Top 6.5% on pypi.org
26 versions - Latest release: over 1 year ago - 1 dependent package - 3 dependent repositories - 441 downloads last month - 561 stars on GitHub - 1 maintainer
kglab 0.6.6 💰
A simple abstraction layer in Python for building knowledge graphs26 versions - Latest release: over 1 year ago - 1 dependent package - 3 dependent repositories - 441 downloads last month - 561 stars on GitHub - 1 maintainer
hot-fair-utilities 1.2.3 💰
Utilities for AI - Assisted Mapping fAIr22 versions - Latest release: 7 months ago - 125 downloads last month - 11 stars on GitHub - 3 maintainers
pipeless-ai 0.1.19
An open-source computer vision framework to create and deploy computer vision applications that s...20 versions - Latest release: 6 months ago - 2 dependent packages - 1 dependent repositories - 125 downloads last month - 519 stars on GitHub - 2 maintainers
pipeless-ai-cli 0.1.16
An open-source computer vision framework to create and deploy computer vision applications that s...17 versions - Latest release: 6 months ago - 96 downloads last month - 519 stars on GitHub - 2 maintainers
Top 9.6% on pypi.org
18 versions - Latest release: 11 months ago - 1 dependent package - 1 dependent repositories - 3.29 thousand downloads last month - 223 stars on GitHub - 2 maintainers
estimagic 0.4.6
Tools to solve difficult numerical optimization problems.18 versions - Latest release: 11 months ago - 1 dependent package - 1 dependent repositories - 3.29 thousand downloads last month - 223 stars on GitHub - 2 maintainers
betabinomial 0.0.2
Beta Binomial test to detect aberration in count data2 versions - Latest release: about 2 years ago - 1 dependent package - 44 downloads last month - 3 stars on GitHub - 1 maintainer
pyagrum-nightly 1.13.2.dev202405081715084036
Bayesian networks and other Probabilistic Graphical Models.1,427 versions - Latest release: 2 days ago - 1 dependent repositories - 60.8 thousand downloads last month - 28 stars on GitLab.com - 1 maintainer
Top 6.9% on pypi.org
89 versions - Latest release: 1 day ago - 6 dependent repositories - 12.7 thousand downloads last month - 28 stars on GitLab.com - 2 maintainers
pyagrum 1.13.2
Bayesian networks and other Probabilistic Graphical Models.89 versions - Latest release: 1 day ago - 6 dependent repositories - 12.7 thousand downloads last month - 28 stars on GitLab.com - 2 maintainers
Top 4.6% on pypi.org
30 versions - Latest release: 5 months ago - 2 dependent packages - 14 dependent repositories - 2.5 thousand downloads last month - 525 stars on GitHub - 8 maintainers
sbi 0.22.0
Simulation-based inference.30 versions - Latest release: 5 months ago - 2 dependent packages - 14 dependent repositories - 2.5 thousand downloads last month - 525 stars on GitHub - 8 maintainers
drf-serializer-inference 0.0.2
Infer Django Rest Framework serializers from callables like functions and classes.2 versions - Latest release: about 1 year ago - 2 dependent packages - 748 downloads last month - 0 stars on GitHub - 2 maintainers
batch-inference 1.0
Batch Inference2 versions - Latest release: 12 months ago - 80 downloads last month - 59 stars on GitHub - 2 maintainers
inference-tools 0.13.0
A collection of python tools for Bayesian data analysis24 versions - Latest release: 5 months ago - 2 dependent packages - 2 dependent repositories - 498 downloads last month - 26 stars on GitHub - 1 maintainer
jimgw 0.1.1
Gravitatioanl wave data analysis tool in Jax4 versions - Latest release: 8 months ago - 56 downloads last month - 49 stars on GitHub - 1 maintainer
optimum-neuron 0.0.22
Optimum Neuron is the interface between the Hugging Face Transformers and Diffusers libraries and...23 versions - Latest release: 2 days ago - 1 dependent repositories - 21.2 thousand downloads last month - 164 stars on GitHub - 6 maintainers
tensorrt-llm 0.9.0
TensorRT-LLM: A TensorRT Toolbox for Large Language Models25 versions - Latest release: 28 days ago - 4.45 thousand downloads last month - 6,670 stars on GitHub - 2 maintainers
triton-model-navigator 0.8.1
Triton Model Navigator: An inference toolkit for optimizing and deploying machine learning models...23 versions - Latest release: about 1 month ago - 1 dependent repositories - 2.24 thousand downloads last month - 157 stars on GitHub - 2 maintainers
autodice 1.0.3.dev2 💰
Automated Distributed CNN inference at the Edge6 versions - Latest release: 10 months ago - 43 downloads last month - 11 stars on GitHub - 2 maintainers
tsdate 0.1.7
Infer node ages from a tree sequence topology.8 versions - Latest release: 4 months ago - 5 dependent repositories - 101 downloads last month - 18 stars on GitHub - 4 maintainers
tensorrt-lean-cu12 10.0.1
A high performance deep learning inference library2 versions - Latest release: 15 days ago - 1.14 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-dispatch-cu12-libs 10.0.1
TensorRT Libraries2 versions - Latest release: 15 days ago - 135 downloads last month - 9,159 stars on GitHub - 2 maintainers
Top 9.3% on pypi.org
4 versions - Latest release: 9 months ago - 866 downloads last month - 9,159 stars on GitHub - 1 maintainer
polygraphy-trtexec 0.0.9
Polygraphy Trtexec: Extension to run on trtexec backend4 versions - Latest release: 9 months ago - 866 downloads last month - 9,159 stars on GitHub - 1 maintainer
tensorrt-cu11 10.0.1
A high performance deep learning inference library2 versions - Latest release: 15 days ago - 461 downloads last month - 9,159 stars on GitHub - 2 maintainers
Top 0.6% on pypi.org
20 versions - Latest release: 15 days ago - 39 dependent packages - 496 dependent repositories - 113 thousand downloads last month - 9,159 stars on GitHub - 1 maintainer
tensorrt 10.0.1
TensorRT Metapackage20 versions - Latest release: 15 days ago - 39 dependent packages - 496 dependent repositories - 113 thousand downloads last month - 9,159 stars on GitHub - 1 maintainer
tensorrt-dispatch 10.0.1
TensorRT Metapackage15 versions - Latest release: 15 days ago - 1 dependent repositories - 1.86 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
Top 3.7% on pypi.org
11 versions - Latest release: about 1 year ago - 12 dependent packages - 4 dependent repositories - 11.1 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-bindings 8.6.1
A high performance deep learning inference library11 versions - Latest release: about 1 year ago - 12 dependent packages - 4 dependent repositories - 11.1 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
Top 1.5% on pypi.org
4 versions - Latest release: over 1 year ago - 6 dependent packages - 93 dependent repositories - 15.4 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
nvidia-tensorrt 99.0.0
A high performance deep learning inference library4 versions - Latest release: over 1 year ago - 6 dependent packages - 93 dependent repositories - 15.4 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-lean-cu11-bindings 10.0.1
A high performance deep learning inference library2 versions - Latest release: 15 days ago - 326 downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-dispatch-bindings 8.6.1
A high performance deep learning inference library11 versions - Latest release: about 1 year ago - 1 dependent repositories - 94 downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-lean-bindings 8.6.1
A high performance deep learning inference library11 versions - Latest release: about 1 year ago - 1 dependent repositories - 70 downloads last month - 9,159 stars on GitHub - 2 maintainers
trt-engine-explorer 0.1.5
NVIDIA's experimental tool to explore TRT engines4 versions - Latest release: 6 months ago - 48 downloads last month - 9,159 stars on GitHub - 2 maintainers
Top 2.7% on pypi.org
3 versions - Latest release: 26 days ago - 7 dependent packages - 28 dependent repositories - 65.1 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
onnx-graphsurgeon 0.5.2
ONNX GraphSurgeon3 versions - Latest release: 26 days ago - 7 dependent packages - 28 dependent repositories - 65.1 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-lean-cu12-bindings 10.0.1
A high performance deep learning inference library2 versions - Latest release: 15 days ago - 347 downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-cu12 10.0.1
A high performance deep learning inference library2 versions - Latest release: 15 days ago - 17.9 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-dispatch-cu11 10.0.1
A high performance deep learning inference library2 versions - Latest release: 15 days ago - 105 downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-dispatch-cu12 10.0.1
A high performance deep learning inference library2 versions - Latest release: 15 days ago - 1.06 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-lean 10.0.1
TensorRT Metapackage15 versions - Latest release: 15 days ago - 1 dependent repositories - 2.06 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
Top 1.1% on pypi.org
5 versions - Latest release: 29 days ago - 5 dependent packages - 188 dependent repositories - 28.3 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
polygraphy 0.49.9
Polygraphy: A Deep Learning Inference Prototyping and Debugging Toolkit5 versions - Latest release: 29 days ago - 5 dependent packages - 188 dependent repositories - 28.3 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-dispatch-cu11-bindings 10.0.1
A high performance deep learning inference library2 versions - Latest release: 15 days ago - 320 downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-cu12-libs 10.0.1
TensorRT Libraries2 versions - Latest release: 15 days ago - 955 downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-dispatch-cu12-bindings 10.0.1
A high performance deep learning inference library2 versions - Latest release: 15 days ago - 344 downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-dispatch-cu11-libs 10.0.1
TensorRT Libraries2 versions - Latest release: 15 days ago - 99 downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-lean-cu11-libs 10.0.1
TensorRT Libraries2 versions - Latest release: 15 days ago - 94 downloads last month - 9,146 stars on GitHub - 2 maintainers
tensorrt-cu11-bindings 10.0.1
A high performance deep learning inference library2 versions - Latest release: 15 days ago - 367 downloads last month - 9,146 stars on GitHub - 2 maintainers
tensorrt-lean-cu12-libs 10.0.1
TensorRT Libraries2 versions - Latest release: 15 days ago - 135 downloads last month - 9,146 stars on GitHub - 2 maintainers
tensorrt-lean-cu11 10.0.1
A high performance deep learning inference library2 versions - Latest release: 15 days ago - 109 downloads last month - 9,146 stars on GitHub - 2 maintainers
tensorrt-cu12-bindings 10.0.1
A high performance deep learning inference library2 versions - Latest release: 15 days ago - 461 downloads last month - 9,054 stars on GitHub - 2 maintainers
tensorrt-cu11-libs 10.0.1
TensorRT Libraries2 versions - Latest release: 15 days ago - 184 downloads last month - 9,146 stars on GitHub - 2 maintainers
Top 1.9% on pypi.org
105 versions - Latest release: 15 days ago - 19 dependent packages - 48 dependent repositories - 424 thousand downloads last month - 2,812 stars on GitHub - 5 maintainers
ctranslate2 4.2.1
Fast inference engine for Transformer models105 versions - Latest release: 15 days ago - 19 dependent packages - 48 dependent repositories - 424 thousand downloads last month - 2,812 stars on GitHub - 5 maintainers
geo-espresso 0.3.13
Earth Science PRoblems for the Evaluation of Strategies, Solvers and Optimizers20 versions - Latest release: about 2 months ago - 1 dependent repositories - 730 downloads last month - 1 stars on GitHub - 6 maintainers
Top 10.0% on pypi.org
49 versions - Latest release: about 2 months ago - 2 dependent repositories - 751 downloads last month - 1 stars on GitHub - 3 maintainers
cofi 0.2.8
Common Framework for Inference49 versions - Latest release: about 2 months ago - 2 dependent repositories - 751 downloads last month - 1 stars on GitHub - 3 maintainers
friendli-client 1.3.4
Client of Friendli Suite.13 versions - Latest release: about 1 month ago - 3.66 thousand downloads last month - 33 stars on GitHub - 2 maintainers
periflow-client 0.2.2
Client of PeriFlow, the fastest generative AI serving available.17 versions - Latest release: about 1 month ago - 151 downloads last month - 33 stars on GitHub - 1 maintainer
Top 3.2% on pypi.org
47 versions - Latest release: 7 months ago - 1 dependent package - 35 dependent repositories - 84.2 thousand downloads last month - 356 stars on GitHub - 2 maintainers
sagemaker-inference 1.10.1
Open source toolkit for helping create serving containers to run on Amazon SageMaker.47 versions - Latest release: 7 months ago - 1 dependent package - 35 dependent repositories - 84.2 thousand downloads last month - 356 stars on GitHub - 2 maintainers
image-dataset-converter-redis 0.0.1
Redis integration for the image-dataset-converter library.1 version - Latest release: 4 days ago - 125 downloads last month - 0 stars on GitHub - 2 maintainers
deconfounderla 0.0.1
Functions needed to perform causal inference1 version - Latest release: about 1 year ago - 9 downloads last month - 2 maintainers
neural-boost 0.0.5
Neural Booster targeting to boost inference performance.1 version - Latest release: almost 2 years ago - 1 dependent repositories - 9 downloads last month - 6 stars on GitHub - 2 maintainers
Top 7.0% on pypi.org
6 versions - Latest release: over 6 years ago - 2 dependent packages - 17 dependent repositories - 3.11 thousand downloads last month - 23 stars on GitHub - 2 maintainers
strconv 0.4.2
String type inference and conversion6 versions - Latest release: over 6 years ago - 2 dependent packages - 17 dependent repositories - 3.11 thousand downloads last month - 23 stars on GitHub - 2 maintainers
Related Keywords
deep-learning
101
machine-learning
77
python
69
pytorch
62
tensorrt
52
nvidia
38
machine learning
37
ai
36
onnx
36
computer-vision
35
nlp
30
llm
29
gpu-acceleration
29
deeplearning
28
transformer
25
mlops
25
transformers
24
tensorflow
22
quantization
21
object-detection
21
gpt
20
model-serving
19
deep learning
19
llama
19
server
18
inference-server
18
llmops
17
bayesian
17
sampling
16
llm-serving
16
cuda
16
bayesian-inference
16
framework
16
artificial-intelligence
16
statistics
16
llm-inference
15
deployment
15
AI
15
pruning
13
model
13
neural network
12
causal
12
keras
12
yolo
12
inferentia
12
amd
11
rocm
11
trainium
11
mcmc
11
openvino
11
video-processing
10
training
10
onnxruntime
10
stream-processing
10
pipeline-framework
10
perception
10
inference-api
10
generative-ai
10
pipeline
10
jetson
10
sparsity
10
models
9
triton
9
ml
9
cpu
9
python3
9
huggingface
9
docker
9
android
9
speech-recognition
9
computer vision
9
causality
9
serving
9
inference-engine
9
torch
8
gpu
8
classification
8
data-science
7
network
7
deep-neural-networks
7
scikit-learn
7
simulation
7
jax
7
service
7
data
7
client
7
yolov8
7
yolov5
7
optimization
7
neural-network
7
Inference
7
pretrained-models
7
distributed
7
llama2
7
instance-segmentation
7
parameter
6
graph-based
6
vit
6
sparsification
6
rdf
6