Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org "inference-api" keyword
Top 10.0% on pypi.org
46 versions - Latest release: 27 days ago - 3 dependent packages - 1 dependent repositories - 9.55 thousand downloads last month - 1,026 stars on GitHub - 3 maintainers
inference-cli 0.10.0
With no prior knowledge of machine learning or device-specific deployment, you can deploy a compu...46 versions - Latest release: 27 days ago - 3 dependent packages - 1 dependent repositories - 9.55 thousand downloads last month - 1,026 stars on GitHub - 3 maintainers
inference-core 0.10.0
With no prior knowledge of machine learning or device-specific deployment, you can deploy a compu...45 versions - Latest release: 27 days ago - 484 downloads last month - 1,026 stars on GitHub - 5 maintainers
Top 5.9% on pypi.org
45 versions - Latest release: 27 days ago - 11 dependent repositories - 16.5 thousand downloads last month - 1,026 stars on GitHub - 4 maintainers
inference 0.10.0
With no prior knowledge of machine learning or device-specific deployment, you can deploy a compu...45 versions - Latest release: 27 days ago - 11 dependent repositories - 16.5 thousand downloads last month - 1,026 stars on GitHub - 4 maintainers
inference-sdk 0.10.0
With no prior knowledge of machine learning or device-specific deployment, you can deploy a compu...35 versions - Latest release: 27 days ago - 2 dependent packages - 14 thousand downloads last month - 1,026 stars on GitHub - 3 maintainers
inference-cpu 0.10.0
With no prior knowledge of machine learning or device-specific deployment, you can deploy a compu...45 versions - Latest release: 27 days ago - 526 downloads last month - 1,026 stars on GitHub - 5 maintainers
inference-gpu 0.10.0
With no prior knowledge of machine learning or device-specific deployment, you can deploy a compu...45 versions - Latest release: 27 days ago - 13 thousand downloads last month - 1,026 stars on GitHub - 5 maintainers
prompton 0.0.10
Chat prompt template evaluation and inference monitoring9 versions - Latest release: 11 months ago - 21 downloads last month - 7 stars on GitHub - 1 maintainer
textsum 0.2.1
utility for using transformers summarization models on text docs6 versions - Latest release: 4 months ago - 1 dependent package - 1 dependent repositories - 500 downloads last month - 110 stars on GitHub - 1 maintainer
Top 3.6% on pypi.org
218 versions - Latest release: about 1 month ago - 2 dependent packages - 5 dependent repositories - 28 thousand downloads last month - 844 stars on GitHub - 6 maintainers
truss 0.9.11
A seamless bridge from model development to model delivery218 versions - Latest release: about 1 month ago - 2 dependent packages - 5 dependent repositories - 28 thousand downloads last month - 844 stars on GitHub - 6 maintainers
qai-hub-models 0.5.1
Models optimized for export to run on device.19 versions - Latest release: about 1 month ago - 1.33 thousand downloads last month - 279 stars on GitHub - 1 maintainer
llm-magnet 0.2.7
the small distributed language model toolkit. fine-tune state-of-the-art LLMs anywhere, rapidly.27 versions - Latest release: 2 months ago - 123 downloads last month - 18 stars on GitHub - 1 maintainer
mldrop-client 0.1.1
Python client for MLDrop by Scattering AI2 versions - Latest release: over 1 year ago - 5 downloads last month - 3 stars on GitHub - 1 maintainer
geniusrise-text 0.1.13
Text bolts for geniusrise14 versions - Latest release: 3 months ago - 86 downloads last month - 2 stars on GitHub - 1 maintainer
semantic-ai 0.0.5
Sematic AI RAG System6 versions - Latest release: 4 months ago - 60 downloads last month - 11 stars on GitHub - 1 maintainer
bentoml-core 0.1.0
The rust core of BentoML: The Unified Model Serving Framework2 versions - Latest release: about 1 year ago - 35 downloads last month - 6,591 stars on GitHub - 2 maintainers
yatai 0.0.1
Model and deployment management for BentoML1 version - Latest release: almost 3 years ago - 1 dependent repositories - 32 downloads last month - 6,591 stars on GitHub - 1 maintainer
sentencebertservice 20211205152102
BentoML generated model module1 version - Latest release: over 2 years ago - 1 dependent repositories - 26 downloads last month - 6,591 stars on GitHub - 1 maintainer
Related Keywords
machine-learning
12
inference
10
inference-server
8
deployment
7
onnx
7
yolov8
6
yolov7
6
yolov5
6
yolact
6
vit
6
tensorrt
6
server
6
python
6
object-detection
6
jetson
6
instance-segmentation
6
docker
6
computer-vision
6
classification
6
model-serving
5
ai
5
mlops
4
deep-learning
4
model-inference
3
model-deployment
3
ml-platform
3
microservices
3
lmops
3
llmops
3
kubernetes
3
generative-ai
3
bentoml
3
ai-infra
3
model-management
3
multimodal-deep-learning
3
llm
2
MLOps
2
AI
2
huggingface
2
pytorch
2
Model Serving
2
Model Deployment
2
fastapi
1
rag
1
document-parser
1
semantic-search
1
approximate-nearest-neighbor-search
1
docx
1
openai
1
deep-neural-networks
1
ocr
1
pdf
1
data processing
1
machine learning
1
geniusrise
1
transformers
1
python3
1
Machine Learning
1
chatgpt
1
large-language-models
1
prompt-engineering
1
prompt-tuning
1
split-testing
1
batch-processing
1
pipeline
1
summarization
1
summary
1
text
1
text-to-text-transformer
1
transformer
1
BentoML
1
llama2
1
retrieval-augmented-generation
1
openai-api
1
vector-database
1
embeddings
1
distributed-systems
1
distributed-computing
1
claude
1
apple-silicon
1
tensorflow-lite
1
qnn
1
falcon
1
machinelearning
1
inference-engine
1
demos
1
deeplearning
1
wizardlm
1
whisper
1
stable-diffusion
1
packaging
1
open-source
1
production
1
serving
1
artificial-intelligence
1
tokenizers
1
sentence-splitting
1
nats-streaming
1
nats-messaging
1
nats
1