Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org "inference-api" keyword
Top 3.6% on pypi.org
212 versions - Latest release: 4 days ago - 2 dependent packages - 5 dependent repositories - 37.3 thousand downloads last month - 838 stars on GitHub - 6 maintainers
truss 0.9.11
A seamless bridge from model development to model delivery212 versions - Latest release: 4 days ago - 2 dependent packages - 5 dependent repositories - 37.3 thousand downloads last month - 838 stars on GitHub - 6 maintainers
Top 1.2% on pypi.org
146 versions - Latest release: 3 days ago - 10 dependent packages - 499 dependent repositories - 85.7 thousand downloads last month - 6,561 stars on GitHub - 4 maintainers
bentoml 1.2.15
BentoML: Build Production-Grade AI Applications146 versions - Latest release: 3 days ago - 10 dependent packages - 499 dependent repositories - 85.7 thousand downloads last month - 6,561 stars on GitHub - 4 maintainers
prompton 0.0.10
Chat prompt template evaluation and inference monitoring9 versions - Latest release: 10 months ago - 35 downloads last month - 6 stars on GitHub - 2 maintainers
qai-hub-models 0.5.1
Models optimized for export to run on device.17 versions - Latest release: 12 days ago - 902 downloads last month - 213 stars on GitHub - 2 maintainers
sentencebertservice 20211205152102
BentoML generated model module1 version - Latest release: over 2 years ago - 1 dependent repositories - 17 downloads last month - 6,558 stars on GitHub - 1 maintainer
bentoml-core 0.1.0
The rust core of BentoML: The Unified Model Serving Framework2 versions - Latest release: 12 months ago - 34 downloads last month - 6,558 stars on GitHub - 4 maintainers
yatai 0.0.1
Model and deployment management for BentoML1 version - Latest release: almost 3 years ago - 1 dependent repositories - 33 downloads last month - 6,558 stars on GitHub - 2 maintainers
Top 10.0% on pypi.org
41 versions - Latest release: 12 days ago - 1 dependent repositories - 9.73 thousand downloads last month - 1,026 stars on GitHub - 6 maintainers
inference-cli 0.9.23
With no prior knowledge of machine learning or device-specific deployment, you can deploy a compu...41 versions - Latest release: 12 days ago - 1 dependent repositories - 9.73 thousand downloads last month - 1,026 stars on GitHub - 6 maintainers
inference-gpu 0.9.23
With no prior knowledge of machine learning or device-specific deployment, you can deploy a compu...40 versions - Latest release: 12 days ago - 12.7 thousand downloads last month - 1,026 stars on GitHub - 9 maintainers
inference-core 0.9.23
With no prior knowledge of machine learning or device-specific deployment, you can deploy a compu...40 versions - Latest release: 12 days ago - 373 downloads last month - 1,026 stars on GitHub - 10 maintainers
inference-sdk 0.9.23
With no prior knowledge of machine learning or device-specific deployment, you can deploy a compu...30 versions - Latest release: 12 days ago - 13.6 thousand downloads last month - 1,026 stars on GitHub - 6 maintainers
inference-cpu 0.9.23
With no prior knowledge of machine learning or device-specific deployment, you can deploy a compu...40 versions - Latest release: 12 days ago - 256 downloads last month - 1,026 stars on GitHub - 8 maintainers
Top 5.9% on pypi.org
40 versions - Latest release: 12 days ago - 11 dependent repositories - 14.4 thousand downloads last month - 1,026 stars on GitHub - 8 maintainers
inference 0.9.23
With no prior knowledge of machine learning or device-specific deployment, you can deploy a compu...40 versions - Latest release: 12 days ago - 11 dependent repositories - 14.4 thousand downloads last month - 1,026 stars on GitHub - 8 maintainers
llm-magnet 0.2.7
the small distributed language model toolkit. fine-tune state-of-the-art LLMs anywhere, rapidly.27 versions - Latest release: about 1 month ago - 220 downloads last month - 17 stars on GitHub - 1 maintainer
mldrop-client 0.1.1
Python client for MLDrop by Scattering AI2 versions - Latest release: about 1 year ago - 9 downloads last month - 3 stars on GitHub - 2 maintainers
textsum 0.2.1
utility for using transformers summarization models on text docs6 versions - Latest release: 3 months ago - 1 dependent package - 1 dependent repositories - 716 downloads last month - 106 stars on GitHub - 2 maintainers
geniusrise-text 0.1.13
Text bolts for geniusrise14 versions - Latest release: 2 months ago - 67 downloads last month - 2 stars on GitHub - 2 maintainers
semantic-ai 0.0.5
Sematic AI RAG System6 versions - Latest release: 3 months ago - 97 downloads last month - 11 stars on GitHub - 2 maintainers
Related Keywords
machine-learning
13
inference
10
inference-server
8
onnx
7
deployment
7
classification
6
ai
6
computer-vision
6
docker
6
instance-segmentation
6
jetson
6
yolov8
6
yolov7
6
yolov5
6
yolact
6
vit
6
object-detection
6
model-serving
6
python
6
server
6
tensorrt
6
deep-learning
5
mlops
5
bentoml
4
generative-ai
4
kubernetes
4
llmops
4
lmops
4
microservices
4
ml-platform
4
model-deployment
4
model-inference
4
model-management
4
multimodal-deep-learning
4
ai-infra
4
Model Deployment
3
Model Serving
3
AI
3
MLOps
3
llm
2
huggingface
2
pytorch
2
BentoML
2
text-to-text-transformer
1
text
1
summary
1
summarization
1
pipeline
1
batch-processing
1
python3
1
production
1
serving
1
tokenizers
1
sentence-splitting
1
nats-streaming
1
nats-messaging
1
falcon
1
llama2
1
retrieval-augmented-generation
1
openai-api
1
vector-database
1
fastapi
1
rag
1
document-parser
1
semantic-search
1
approximate-nearest-neighbor-search
1
docx
1
openai
1
deep-neural-networks
1
ocr
1
pdf
1
data processing
1
machine learning
1
geniusrise
1
transformers
1
transformer
1
open-source
1
packaging
1
stable-diffusion
1
whisper
1
wizardlm
1
chatgpt
1
tensorflow-lite
1
qnn
1
large-language-models
1
machinelearning
1
inference-engine
1
prompt-engineering
1
demos
1
deeplearning
1
split-testing
1
prompt-tuning
1
nats
1
mlx
1
mistral
1
milvus
1
llm-training
1
langchain
1
gemini
1
finetuning-llms
1