Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "inference" keyword

skeem 0.1.0
Infer SQL DDL statements from tabular data
1 version - Latest release: about 1 year ago - 14 downloads last month - 3 stars on GitHub - 2 maintainers
Top 8.1% on pypi.org
sparseml-nightly 1.8.0.20240509
Libraries for applying sparsification recipes to neural networks with a few lines of code, enabli...
153 versions - Latest release: about 4 hours ago - 1 dependent package - 1 dependent repositories - 1.07 thousand downloads last month - 1,976 stars on GitHub - 1 maintainer
Top 7.1% on pypi.org
causality 0.0.10
Tools for causal inference
11 versions - Latest release: over 2 years ago - 10 dependent repositories - 192 downloads last month - 1,050 stars on GitHub - 1 maintainer
vllm-xft 0.3.3.0
A high-throughput and memory-efficient inference and serving engine for LLMs
1 version - Latest release: about 1 month ago - 25 downloads last month - 17,633 stars on GitHub - 2 maintainers
llm-swarm 0.1.1
A high-throughput and memory-efficient inference and serving engine for LLMs
2 versions - Latest release: 2 months ago - 79 downloads last month - 17,633 stars on GitHub - 2 maintainers
vllm-acc 0.4.1
A high-throughput and memory-efficient inference and serving engine for LLMs
7 versions - Latest release: 6 days ago - 1.15 thousand downloads last month - 17,633 stars on GitHub - 2 maintainers
Top 3.4% on pypi.org
vllm 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs
26 versions - Latest release: 5 days ago - 7 dependent packages - 5 dependent repositories - 509 thousand downloads last month - 17,633 stars on GitHub - 4 maintainers
nextai-vllm 0.0.7
A high-throughput and memory-efficient inference and serving engine for LLMs
6 versions - Latest release: 15 days ago - 149 downloads last month - 17,633 stars on GitHub - 2 maintainers
vllm-online 0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs
2 versions - Latest release: 11 days ago - 262 downloads last month - 17,633 stars on GitHub - 2 maintainers
tilearn-test01 0.1
A high-throughput and memory-efficient inference and serving engine for LLMs
1 version - Latest release: about 1 month ago - 25 downloads last month - 17,633 stars on GitHub - 2 maintainers
vllm-consul 0.2.1
A high-throughput and memory-efficient inference and serving engine for LLMs
5 versions - Latest release: 7 months ago - 39 downloads last month - 12,665 stars on GitHub - 2 maintainers
superlaser 0.0.6
An MLOps library for LLM deployment w/ the vLLM engine on RunPod's infra.
6 versions - Latest release: 2 months ago - 80 downloads last month - 17,633 stars on GitHub - 2 maintainers
hive-vllm 0.0.1
a
1 version - Latest release: 2 months ago - 7 downloads last month - 17,633 stars on GitHub - 1 maintainer
tilearn-infer 0.3.3
A high-throughput and memory-efficient inference and serving engine for LLMs
3 versions - Latest release: 18 days ago - 255 downloads last month - 17,633 stars on GitHub - 2 maintainers
llm_atc 0.1.7
Tools for fine tuning and serving LLMs
6 versions - Latest release: 5 months ago - 39 downloads last month - 17,633 stars on GitHub - 2 maintainers
flowmc 0.3.3
Normalizing flow exhanced sampler in jax
22 versions - Latest release: 2 days ago - 3.82 thousand downloads last month - 173 stars on GitHub - 2 maintainers
Top 5.2% on pypi.org
deepspeed-mii 0.2.3
deepspeed mii
17 versions - Latest release: 2 months ago - 3 dependent repositories - 5.72 thousand downloads last month - 1,661 stars on GitHub - 2 maintainers
nn-meter 2.0
nn-Meter is a novel and efficient system to accurately predict the inference latency of DNN model...
3 versions - Latest release: almost 2 years ago - 1 dependent repositories - 71 downloads last month - 316 stars on GitHub - 2 maintainers
openvino-nightly 2024.2.0.dev20240509
OpenVINO(TM) Runtime
115 versions - Latest release: about 9 hours ago - 1 dependent repositories - 34.3 thousand downloads last month - 5,906 stars on GitHub - 2 maintainers
lkhandmapping 0.1.2
Deply handtracking model with just few lines of code.
5 versions - Latest release: over 1 year ago - 1 dependent repositories - 34 downloads last month - 25,580 stars on GitHub - 2 maintainers
Top 7.0% on pypi.org
mediapipe-model-maker 0.2.1
MediaPipe Model Maker is a simple, low-code solution for customizing on-device ML models
11 versions - Latest release: 9 months ago - 1 dependent repositories - 12.4 thousand downloads last month - 24,200 stars on GitHub - 1 maintainer
landmark-detection 0.1.1
This is for detect coordinates parts of the body
3 versions - Latest release: almost 3 years ago - 1 dependent repositories - 87 downloads last month - 25,580 stars on GitHub - 1 maintainer
mediapipeopenvino 0.0.2
Towards a subset reimplmention of Mediapipe with OpenVINO tool.
2 versions - Latest release: about 2 years ago - 1 dependent repositories - 135 downloads last month - 25,580 stars on GitHub - 1 maintainer
mediapipe-nightly 0.0.0
MediaPipe is the simplest way for researchers and developers to build world-class ML solutions an...
107 versions - Latest release: 6 months ago - 5.03 thousand downloads last month - 24,200 stars on GitHub - 2 maintainers
astypes 0.2.6
Infer types for AST nodes.
8 versions - Latest release: about 1 year ago - 1 dependent package - 198 downloads last month - 6 stars on GitHub - 2 maintainers
typeql-grammar 2.28.0
TypeQL Grammar for Python
20 versions - Latest release: 28 days ago - 1 dependent repositories - 234 downloads last month - 211 stars on GitHub - 4 maintainers
Top 3.1% on pypi.org
multi-model-server 1.1.11
Multi Model Server is a tool for serving neural net models for inference
1,113 versions - Latest release: 11 months ago - 1 dependent package - 12 dependent repositories - 73 thousand downloads last month - 976 stars on GitHub - 1 maintainer
Top 1.4% on pypi.org
optimum 1.19.2
Optimum Library is an extension of the Hugging Face Transformers library, providing a framework t...
63 versions - Latest release: about 15 hours ago - 51 dependent packages - 715 dependent repositories - 1.12 million downloads last month - 2,003 stars on GitHub - 8 maintainers
ohmlr 0.0.17
One-hot multinomial logisitc regression
7 versions - Latest release: over 5 years ago - 1 dependent repositories - 28 downloads last month - 0 stars on GitHub - 2 maintainers
Top 8.4% on pypi.org
yolort 0.6.3 💰
yolort is a runtime stack for object detection on specialized accelerators.
12 versions - Latest release: about 2 years ago - 2 dependent repositories - 160 downloads last month - 706 stars on GitHub - 1 maintainer
whisper.cpp-cli 0.0.3 💰
A Python package for the whisper.cpp CLI.
4 versions - Latest release: 9 days ago - 2.9 thousand downloads last month - 31,566 stars on GitHub - 1 maintainer
whisper-cpp-python 0.2.0 💰
A Python wrapper for whisper.cpp
12 versions - Latest release: 12 months ago - 1 dependent package - 1 dependent repositories - 359 downloads last month - 31,566 stars on GitHub - 2 maintainers
pasp-plp 0.0.4
Probabilistic Answer Set Programming
15 versions - Latest release: 11 months ago - 48 downloads last month - 15 stars on GitHub - 1 maintainer
everai 0.1.47
Client library to manage everai infrastructure
24 versions - Latest release: about 19 hours ago - 1.17 thousand downloads last month - 2 maintainers
Top 6.1% on pypi.org
causallib 0.9.6
A Python package for flexible and modular causal inference modeling
14 versions - Latest release: 7 months ago - 3 dependent repositories - 2.1 thousand downloads last month - 663 stars on GitHub - 2 maintainers
Top 5.7% on pypi.org
simplet5 0.1.4
simpleT5 is built on top of PyTorch-lightning ⚡️ and Transformers 🤗 that lets you quickly train y...
7 versions - Latest release: about 2 years ago - 10 dependent repositories - 4.16 thousand downloads last month - 382 stars on GitHub - 2 maintainers
ppi-python 0.2.2
Prediction-Powered Inference
7 versions - Latest release: 2 months ago - 1.28 thousand downloads last month - 163 stars on GitHub - 2 maintainers
pyridge 0.1.0
Efficient grid-based evaluation of probability distributions
1 version - Latest release: 3 days ago - 172 downloads last month - 0 stars on GitHub - 2 maintainers
whisper-ane 0.1.0
ANE optimised adaptation of Whisper for optimised inference
1 version - Latest release: about 1 year ago - 20 downloads last month - 2,479 stars on GitHub - 2 maintainers
Top 3.5% on pypi.org
woodwork 0.30.0
a data typing library for machine learning
60 versions - Latest release: 29 days ago - 10 dependent packages - 33 dependent repositories - 60.8 thousand downloads last month - 139 stars on GitHub - 11 maintainers
Top 8.3% on pypi.org
qonnx 0.3.0
Frontend and utilities for QONNX
3 versions - Latest release: 10 months ago - 3 dependent packages - 1 dependent repositories - 31.2 thousand downloads last month - 96 stars on GitHub - 1 maintainer
Top 0.5% on pypi.org
mediapipe 0.10.14
MediaPipe is the simplest way for researchers and developers to build world-class ML solutions an...
41 versions - Latest release: 1 day ago - 99 dependent packages - 2,464 dependent repositories - 1.08 million downloads last month - 25,567 stars on GitHub - 2 maintainers
infer-camembert 0.2.0
Python implementation for text classification inference with CamemBERT fine-tuned models
3 versions - Latest release: 3 months ago - 29 downloads last month - 2 stars on GitHub - 2 maintainers
Top 6.5% on pypi.org
kglab 0.6.6 💰
A simple abstraction layer in Python for building knowledge graphs
26 versions - Latest release: over 1 year ago - 1 dependent package - 3 dependent repositories - 441 downloads last month - 561 stars on GitHub - 1 maintainer
hot-fair-utilities 1.2.3 💰
Utilities for AI - Assisted Mapping fAIr
22 versions - Latest release: 7 months ago - 125 downloads last month - 11 stars on GitHub - 3 maintainers
pipeless-ai 0.1.19
An open-source computer vision framework to create and deploy computer vision applications that s...
20 versions - Latest release: 6 months ago - 2 dependent packages - 1 dependent repositories - 125 downloads last month - 519 stars on GitHub - 2 maintainers
pipeless-ai-cli 0.1.16
An open-source computer vision framework to create and deploy computer vision applications that s...
17 versions - Latest release: 6 months ago - 96 downloads last month - 519 stars on GitHub - 2 maintainers
Top 9.6% on pypi.org
estimagic 0.4.6
Tools to solve difficult numerical optimization problems.
18 versions - Latest release: 11 months ago - 1 dependent package - 1 dependent repositories - 3.29 thousand downloads last month - 223 stars on GitHub - 2 maintainers
betabinomial 0.0.2
Beta Binomial test to detect aberration in count data
2 versions - Latest release: about 2 years ago - 1 dependent package - 44 downloads last month - 3 stars on GitHub - 1 maintainer
pyagrum-nightly 1.13.2.dev202405081715084036
Bayesian networks and other Probabilistic Graphical Models.
1,427 versions - Latest release: 2 days ago - 1 dependent repositories - 60.8 thousand downloads last month - 28 stars on GitLab.com - 1 maintainer
Top 6.9% on pypi.org
pyagrum 1.13.2
Bayesian networks and other Probabilistic Graphical Models.
89 versions - Latest release: 1 day ago - 6 dependent repositories - 12.7 thousand downloads last month - 28 stars on GitLab.com - 2 maintainers
Top 4.6% on pypi.org
sbi 0.22.0
Simulation-based inference.
30 versions - Latest release: 5 months ago - 2 dependent packages - 14 dependent repositories - 2.5 thousand downloads last month - 525 stars on GitHub - 8 maintainers
drf-serializer-inference 0.0.2
Infer Django Rest Framework serializers from callables like functions and classes.
2 versions - Latest release: about 1 year ago - 2 dependent packages - 748 downloads last month - 0 stars on GitHub - 2 maintainers
batch-inference 1.0
Batch Inference
2 versions - Latest release: 12 months ago - 80 downloads last month - 59 stars on GitHub - 2 maintainers
inference-tools 0.13.0
A collection of python tools for Bayesian data analysis
24 versions - Latest release: 5 months ago - 2 dependent packages - 2 dependent repositories - 498 downloads last month - 26 stars on GitHub - 1 maintainer
jimgw 0.1.1
Gravitatioanl wave data analysis tool in Jax
4 versions - Latest release: 8 months ago - 56 downloads last month - 49 stars on GitHub - 1 maintainer
optimum-neuron 0.0.22
Optimum Neuron is the interface between the Hugging Face Transformers and Diffusers libraries and...
23 versions - Latest release: 2 days ago - 1 dependent repositories - 21.2 thousand downloads last month - 164 stars on GitHub - 6 maintainers
tensorrt-llm 0.9.0
TensorRT-LLM: A TensorRT Toolbox for Large Language Models
25 versions - Latest release: 28 days ago - 4.45 thousand downloads last month - 6,670 stars on GitHub - 2 maintainers
triton-model-navigator 0.8.1
Triton Model Navigator: An inference toolkit for optimizing and deploying machine learning models...
23 versions - Latest release: about 1 month ago - 1 dependent repositories - 2.24 thousand downloads last month - 157 stars on GitHub - 2 maintainers
autodice 1.0.3.dev2 💰
Automated Distributed CNN inference at the Edge
6 versions - Latest release: 10 months ago - 43 downloads last month - 11 stars on GitHub - 2 maintainers
tsdate 0.1.7
Infer node ages from a tree sequence topology.
8 versions - Latest release: 4 months ago - 5 dependent repositories - 101 downloads last month - 18 stars on GitHub - 4 maintainers
tensorrt-lean-cu12 10.0.1
A high performance deep learning inference library
2 versions - Latest release: 15 days ago - 1.14 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-dispatch-cu12-libs 10.0.1
TensorRT Libraries
2 versions - Latest release: 15 days ago - 135 downloads last month - 9,159 stars on GitHub - 2 maintainers
Top 9.3% on pypi.org
polygraphy-trtexec 0.0.9
Polygraphy Trtexec: Extension to run on trtexec backend
4 versions - Latest release: 9 months ago - 866 downloads last month - 9,159 stars on GitHub - 1 maintainer
tensorrt-cu11 10.0.1
A high performance deep learning inference library
2 versions - Latest release: 15 days ago - 461 downloads last month - 9,159 stars on GitHub - 2 maintainers
Top 0.6% on pypi.org
tensorrt 10.0.1
TensorRT Metapackage
20 versions - Latest release: 15 days ago - 39 dependent packages - 496 dependent repositories - 113 thousand downloads last month - 9,159 stars on GitHub - 1 maintainer
tensorrt-dispatch 10.0.1
TensorRT Metapackage
15 versions - Latest release: 15 days ago - 1 dependent repositories - 1.86 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
Top 3.7% on pypi.org
tensorrt-bindings 8.6.1
A high performance deep learning inference library
11 versions - Latest release: about 1 year ago - 12 dependent packages - 4 dependent repositories - 11.1 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
Top 1.5% on pypi.org
nvidia-tensorrt 99.0.0
A high performance deep learning inference library
4 versions - Latest release: over 1 year ago - 6 dependent packages - 93 dependent repositories - 15.4 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-lean-cu11-bindings 10.0.1
A high performance deep learning inference library
2 versions - Latest release: 15 days ago - 326 downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-dispatch-bindings 8.6.1
A high performance deep learning inference library
11 versions - Latest release: about 1 year ago - 1 dependent repositories - 94 downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-lean-bindings 8.6.1
A high performance deep learning inference library
11 versions - Latest release: about 1 year ago - 1 dependent repositories - 70 downloads last month - 9,159 stars on GitHub - 2 maintainers
trt-engine-explorer 0.1.5
NVIDIA's experimental tool to explore TRT engines
4 versions - Latest release: 6 months ago - 48 downloads last month - 9,159 stars on GitHub - 2 maintainers
Top 2.7% on pypi.org
onnx-graphsurgeon 0.5.2
ONNX GraphSurgeon
3 versions - Latest release: 26 days ago - 7 dependent packages - 28 dependent repositories - 65.1 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-lean-cu12-bindings 10.0.1
A high performance deep learning inference library
2 versions - Latest release: 15 days ago - 347 downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-cu12 10.0.1
A high performance deep learning inference library
2 versions - Latest release: 15 days ago - 17.9 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-dispatch-cu11 10.0.1
A high performance deep learning inference library
2 versions - Latest release: 15 days ago - 105 downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-dispatch-cu12 10.0.1
A high performance deep learning inference library
2 versions - Latest release: 15 days ago - 1.06 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-lean 10.0.1
TensorRT Metapackage
15 versions - Latest release: 15 days ago - 1 dependent repositories - 2.06 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
Top 1.1% on pypi.org
polygraphy 0.49.9
Polygraphy: A Deep Learning Inference Prototyping and Debugging Toolkit
5 versions - Latest release: 29 days ago - 5 dependent packages - 188 dependent repositories - 28.3 thousand downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-dispatch-cu11-bindings 10.0.1
A high performance deep learning inference library
2 versions - Latest release: 15 days ago - 320 downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-cu12-libs 10.0.1
TensorRT Libraries
2 versions - Latest release: 15 days ago - 955 downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-dispatch-cu12-bindings 10.0.1
A high performance deep learning inference library
2 versions - Latest release: 15 days ago - 344 downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-dispatch-cu11-libs 10.0.1
TensorRT Libraries
2 versions - Latest release: 15 days ago - 99 downloads last month - 9,159 stars on GitHub - 2 maintainers
tensorrt-lean-cu11-libs 10.0.1
TensorRT Libraries
2 versions - Latest release: 15 days ago - 94 downloads last month - 9,146 stars on GitHub - 2 maintainers
tensorrt-cu11-bindings 10.0.1
A high performance deep learning inference library
2 versions - Latest release: 15 days ago - 367 downloads last month - 9,146 stars on GitHub - 2 maintainers
tensorrt-lean-cu12-libs 10.0.1
TensorRT Libraries
2 versions - Latest release: 15 days ago - 135 downloads last month - 9,146 stars on GitHub - 2 maintainers
tensorrt-lean-cu11 10.0.1
A high performance deep learning inference library
2 versions - Latest release: 15 days ago - 109 downloads last month - 9,146 stars on GitHub - 2 maintainers
tensorrt-cu12-bindings 10.0.1
A high performance deep learning inference library
2 versions - Latest release: 15 days ago - 461 downloads last month - 9,054 stars on GitHub - 2 maintainers
tensorrt-cu11-libs 10.0.1
TensorRT Libraries
2 versions - Latest release: 15 days ago - 184 downloads last month - 9,146 stars on GitHub - 2 maintainers
Top 1.9% on pypi.org
ctranslate2 4.2.1
Fast inference engine for Transformer models
105 versions - Latest release: 15 days ago - 19 dependent packages - 48 dependent repositories - 424 thousand downloads last month - 2,812 stars on GitHub - 5 maintainers
geo-espresso 0.3.13
Earth Science PRoblems for the Evaluation of Strategies, Solvers and Optimizers
20 versions - Latest release: about 2 months ago - 1 dependent repositories - 730 downloads last month - 1 stars on GitHub - 6 maintainers
Top 10.0% on pypi.org
cofi 0.2.8
Common Framework for Inference
49 versions - Latest release: about 2 months ago - 2 dependent repositories - 751 downloads last month - 1 stars on GitHub - 3 maintainers
friendli-client 1.3.4
Client of Friendli Suite.
13 versions - Latest release: about 1 month ago - 3.66 thousand downloads last month - 33 stars on GitHub - 2 maintainers
periflow-client 0.2.2
Client of PeriFlow, the fastest generative AI serving available.
17 versions - Latest release: about 1 month ago - 151 downloads last month - 33 stars on GitHub - 1 maintainer
Top 3.2% on pypi.org
sagemaker-inference 1.10.1
Open source toolkit for helping create serving containers to run on Amazon SageMaker.
47 versions - Latest release: 7 months ago - 1 dependent package - 35 dependent repositories - 84.2 thousand downloads last month - 356 stars on GitHub - 2 maintainers
image-dataset-converter-redis 0.0.1
Redis integration for the image-dataset-converter library.
1 version - Latest release: 4 days ago - 125 downloads last month - 0 stars on GitHub - 2 maintainers
deconfounderla 0.0.1
Functions needed to perform causal inference
1 version - Latest release: about 1 year ago - 9 downloads last month - 2 maintainers
neural-boost 0.0.5
Neural Booster targeting to boost inference performance.
1 version - Latest release: almost 2 years ago - 1 dependent repositories - 9 downloads last month - 6 stars on GitHub - 2 maintainers
Top 7.0% on pypi.org
strconv 0.4.2
String type inference and conversion
6 versions - Latest release: over 6 years ago - 2 dependent packages - 17 dependent repositories - 3.11 thousand downloads last month - 23 stars on GitHub - 2 maintainers