Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
proxy.golang.org "inference" keyword
Top 1.9% on proxy.golang.org
315 versions - Latest release: 4 months ago - 21 dependent packages - 18 dependent repositories - 12,105 stars on GitHub
github.com/ggerganov/whisper.cpp/bindings/go v0.0.0-20240122130235-1cf679dec4ec 💰
github.com/ggerganov/whisper.cpp/bindings/go provides a speech-to-text service bindings for the G...315 versions - Latest release: 4 months ago - 21 dependent packages - 18 dependent repositories - 12,105 stars on GitHub
Top 3.9% on proxy.golang.org
17 versions - Latest release: about 1 month ago - 1 dependent repositories - 12,105 stars on GitHub
github.com/ggerganov/whisper.cpp v1.5.5 💰
Port of OpenAI's Whisper model in C/C++17 versions - Latest release: about 1 month ago - 1 dependent repositories - 12,105 stars on GitHub
Top 7.0% on proxy.golang.org
56 versions - Latest release: over 2 years ago - 1 dependent package - 659 stars on GitHub
github.com/onepanelio/core v1.0.2
The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and autom...56 versions - Latest release: over 2 years ago - 1 dependent package - 659 stars on GitHub
Top 9.6% on proxy.golang.org
23 versions - Latest release: 14 days ago - 13,666 stars on GitHub
github.com/vllm-project/vllm v0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs23 versions - Latest release: 14 days ago - 13,666 stars on GitHub
Top 9.1% on proxy.golang.org
1 version - Latest release: 2 months ago - 97 stars on GitHub
github.com/missingstudio/ai v0.0.1
🌈 A Reliable AI Gateway - Core infrastructure stack for building your AI workforce1 version - Latest release: 2 months ago - 97 stars on GitHub
Top 9.9% on proxy.golang.org
14 versions - Latest release: 27 days ago - 80 stars on GitHub
github.com/sozercan/aikit v0.8.0
🏗️ AI + BuildKit = AIKit: Build and deploy open-source LLMs easily!14 versions - Latest release: 27 days ago - 80 stars on GitHub
Top 4.5% on proxy.golang.org
13 versions - Latest release: over 1 year ago - 2,623 stars on GitHub
github.com/bytedance/lightseq v3.0.1+incompatible
LightSeq: A High Performance Library for Sequence Processing and Generation13 versions - Latest release: over 1 year ago - 2,623 stars on GitHub
Top 6.4% on proxy.golang.org
1 version - Latest release: over 2 years ago - 25 stars on GitHub
github.com/patrikeh/go-topics v0.0.0-20220129155034-3523ad274ad5
Latent Dirichlet Allocation1 version - Latest release: over 2 years ago - 25 stars on GitHub
Top 9.1% on proxy.golang.org
Latest release: 4 days ago - 26 stars on GitHub
github.com/missingstudio/ai/gateway
🌈 A Reliable Open Source AI studio - building core infrastructure stack for LLM ApplicationsLatest release: 4 days ago - 26 stars on GitHub
Top 9.1% on proxy.golang.org
Latest release: 4 days ago - 26 stars on GitHub
github.com/missingstudio/ai/protos
🌈 A Reliable Open Source AI studio - building core infrastructure stack for LLM ApplicationsLatest release: 4 days ago - 26 stars on GitHub
Top 9.1% on proxy.golang.org
Latest release: 4 days ago - 26 stars on GitHub
github.com/missingstudio/ai/common
🌈 A Reliable Open Source AI studio - building core infrastructure stack for LLM ApplicationsLatest release: 4 days ago - 26 stars on GitHub
Top 8.2% on proxy.golang.org
85 versions - Latest release: 26 days ago - 9,602 stars on GitHub
github.com/microsoft/deepspeed v0.14.2
DeepSpeed is a deep learning optimization library that makes distributed training and inference e...85 versions - Latest release: 26 days ago - 9,602 stars on GitHub
Top 5.6% on proxy.golang.org
7 versions - Latest release: almost 4 years ago - 1,375 stars on GitHub
github.com/Tencent/TurboTransformers v4.1.0+incompatible
a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on...7 versions - Latest release: almost 4 years ago - 1,375 stars on GitHub
Top 5.8% on proxy.golang.org
7 versions - Latest release: almost 4 years ago - 1,362 stars on GitHub
github.com/tencent/turbotransformers v4.1.0+incompatible
a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on...7 versions - Latest release: almost 4 years ago - 1,362 stars on GitHub
Top 9.6% on proxy.golang.org
32 versions - Latest release: 22 days ago - 36,220 stars on GitHub
github.com/hpcaitech/ColossalAI v0.3.7
Making large AI models cheaper, faster and more accessible32 versions - Latest release: 22 days ago - 36,220 stars on GitHub
Top 9.6% on proxy.golang.org
32 versions - Latest release: 22 days ago - 36,220 stars on GitHub
github.com/hpcaitech/colossalai v0.3.7
Making large AI models cheaper, faster and more accessible32 versions - Latest release: 22 days ago - 36,220 stars on GitHub
Top 6.6% on proxy.golang.org
10 versions - Latest release: about 2 months ago - 1 dependent repositories - 121 stars on GitHub
github.com/nikolaydubina/llama2.go v0.7.1
LLaMA-2 in native Go10 versions - Latest release: about 2 months ago - 1 dependent repositories - 121 stars on GitHub
Top 9.5% on proxy.golang.org
Latest release: 10 days ago - 29 stars on GitHub
github.com/nikolaydubina/go-ml-benchmarks/cgo-version 💰
⏱ Benchmarks of machine learning inference for GoLatest release: 10 days ago - 29 stars on GitHub
Top 9.5% on proxy.golang.org
Latest release: 10 days ago - 29 stars on GitHub
github.com/nikolaydubina/go-ml-benchmarks/go-client 💰
⏱ Benchmarks of machine learning inference for GoLatest release: 10 days ago - 29 stars on GitHub
Top 7.7% on proxy.golang.org
3 versions - Latest release: almost 2 years ago - 3 stars on GitHub
github.com/louisbarrett/gpt3 v1.0.2
CLI client for the OpenAI GPT-3 API in Go3 versions - Latest release: almost 2 years ago - 3 stars on GitHub
Top 4.5% on proxy.golang.org
1 version - Latest release: almost 3 years ago - 1,873 stars on GitHub
github.com/tobegit3hub/tensorflow_template_application v0.0.0-20210520020913-a2be179bf5e2
TensorFlow template application for deep learning1 version - Latest release: almost 3 years ago - 1,873 stars on GitHub
Top 8.2% on proxy.golang.org
10 versions - Latest release: 19 days ago - 6,775 stars on GitHub
github.com/nvidia/tensorrt v10.0.1+incompatible
NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning ...10 versions - Latest release: 19 days ago - 6,775 stars on GitHub
Top 9.6% on proxy.golang.org
12 versions - Latest release: about 2 months ago - 109 stars on GitHub
github.com/aican-research/fast-pathology v1.1.3
⚡ Open-source software for deep learning-based digital pathology12 versions - Latest release: about 2 months ago - 109 stars on GitHub
Top 9.6% on proxy.golang.org
12 versions - Latest release: about 2 months ago - 108 stars on GitHub
github.com/AICAN-Research/FAST-Pathology v1.1.3
⚡ Open-source software for deep learning-based digital pathology12 versions - Latest release: about 2 months ago - 108 stars on GitHub
Top 9.7% on proxy.golang.org
12 versions - Latest release: over 5 years ago - 2 dependent repositories - 5 stars on GitHub
github.com/rai-project/go-caffe v0.4.0
Go binding to Caffe C API to do inference with pre-trained model in Go12 versions - Latest release: over 5 years ago - 2 dependent repositories - 5 stars on GitHub
Top 7.7% on proxy.golang.org
Latest release: 13 days ago - 0 stars on GitHub
github.com/bhojpur/inference
The Bhojpur Inference is a software-as-a-service product used as an Inference Engine based on Bho...Latest release: 13 days ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
21 versions - Latest release: over 1 year ago - 486 stars on GitHub
github.com/h2non/filetype.py v1.2.0
Small, dependency-free, fast Python package to infer binary file types checking the magic numbers...21 versions - Latest release: over 1 year ago - 486 stars on GitHub
Top 8.0% on proxy.golang.org
15 versions - Latest release: over 5 years ago - 2 dependent repositories - 9 stars on GitHub
github.com/rai-project/go-mxnet v0.4.0
Go binding to MXNet C API to do inference with pre-trained model in Go15 versions - Latest release: over 5 years ago - 2 dependent repositories - 9 stars on GitHub
Top 8.2% on proxy.golang.org
35 versions - Latest release: almost 2 years ago - 10 stars on GitHub
github.com/infergo-ml/infergo v1.0.8
mirror of Infergo repository35 versions - Latest release: almost 2 years ago - 10 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: over 5 years ago - 13 stars on GitHub
github.com/chop-dbhi/sql-importer v0.0.0-20180819010211-3e23f1ed50ed
Import CSV files into Postgres with automatic column typing and table creation.1 version - Latest release: over 5 years ago - 13 stars on GitHub
Top 7.6% on proxy.golang.org
2 versions - Latest release: over 5 years ago - 1 dependent repositories - 21 stars on GitHub
github.com/rai-project/go-tensorrt v0.4.0
Go binding to TensorRT C API to do inference with pre-trained model in Go2 versions - Latest release: over 5 years ago - 1 dependent repositories - 21 stars on GitHub
Top 8.2% on proxy.golang.org
14 versions - Latest release: about 5 years ago - 76 stars on GitHub
github.com/anskarl/lomrf v0.7.1
LoMRF is an open-source implementation of Markov Logic Networks14 versions - Latest release: about 5 years ago - 76 stars on GitHub
Top 4.3% on proxy.golang.org
53 versions - Latest release: about 1 month ago - 1 dependent repositories - 6,147 stars on GitHub
github.com/gvergnaud/ts-pattern v5.1.1+incompatible 💰
🎨 The exhaustive Pattern Matching library for TypeScript, with smart type inference.53 versions - Latest release: about 1 month ago - 1 dependent repositories - 6,147 stars on GitHub
Top 9.8% on proxy.golang.org
41 versions - Latest release: 18 days ago - 6,457 stars on GitHub
github.com/huggingface/text-generation-inference v2.0.2+incompatible
Large Language Model Text Generation Inference41 versions - Latest release: 18 days ago - 6,457 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: almost 6 years ago - 55 stars on GitHub
github.com/songtianyi/go-mxnet-predictor v0.0.0-20180606114115-81f1b9cf04f3
go binding for mxnet c_predict_api to do inference with pre-trained model1 version - Latest release: almost 6 years ago - 55 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: over 7 years ago - 63 stars on GitHub
github.com/CogComp/saul v0.4.1
Saul : Declarative Learning-Based Programming1 version - Latest release: over 7 years ago - 63 stars on GitHub
Top 5.5% on proxy.golang.org
Latest release: 22 days ago - 3 dependent repositories - 146 stars on GitHub
github.com/tensorchord/openmodelz/agent
One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP...Latest release: 22 days ago - 3 dependent repositories - 146 stars on GitHub
Top 7.2% on proxy.golang.org
27 versions - Latest release: 8 months ago - 146 stars on GitHub
github.com/tensorchord/openmodelz v0.0.27
One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP...27 versions - Latest release: 8 months ago - 146 stars on GitHub
Top 7.2% on proxy.golang.org
Latest release: 22 days ago - 146 stars on GitHub
github.com/tensorchord/openmodelz/mdz
One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP...Latest release: 22 days ago - 146 stars on GitHub
Top 9.0% on proxy.golang.org
5 versions - Latest release: 2 months ago - 0 stars on GitHub
github.com/leliuga/cohere-configurations v1.4.0
Co:Here Inference configurations5 versions - Latest release: 2 months ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: over 5 years ago - 23 stars on GitHub
github.com/RenatoGeh/gospn v0.1.0
A free, open-source inference and learning library for Sum-Product Networks (SPN)1 version - Latest release: over 5 years ago - 23 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: over 5 years ago - 23 stars on GitHub
github.com/renatogeh/gospn v0.1.0
A free, open-source inference and learning library for Sum-Product Networks (SPN)1 version - Latest release: over 5 years ago - 23 stars on GitHub
Top 4.8% on proxy.golang.org
4 versions - Latest release: over 2 years ago - 566 stars on GitHub
github.com/openvinotoolkit/model_server v2021.4.2+incompatible
A scalable inference server for models optimized with OpenVINO™4 versions - Latest release: over 2 years ago - 566 stars on GitHub
Top 8.2% on proxy.golang.org
65 versions - Latest release: about 2 months ago - 4,958 stars on GitHub
github.com/nvidia/tensorrt-inference-server v2.44.0+incompatible
The Triton Inference Server provides an optimized cloud and edge inferencing solution.65 versions - Latest release: about 2 months ago - 4,958 stars on GitHub
Top 9.0% on proxy.golang.org
1 version - Latest release: 3 months ago - 2 stars on GitHub
github.com/inferret/infer v0.0.1-pre
A declarative DSL (domain-specific language) for IDD (Inference-Driven-Development) and testing o...1 version - Latest release: 3 months ago - 2 stars on GitHub
Top 4.4% on proxy.golang.org
65 versions - Latest release: about 2 months ago - 4,932 stars on GitHub
github.com/triton-inference-server/server v2.44.0+incompatible
The Triton Inference Server provides an optimized cloud and edge inferencing solution.65 versions - Latest release: about 2 months ago - 4,932 stars on GitHub
Top 6.7% on proxy.golang.org
5 versions - Latest release: over 1 year ago - 9 stars on GitHub
github.com/intel-iot-devkit/automated-checkout v2.0.2+incompatible
Deploy sensor fusion technology for an automated checkout that enables real-time insight about th...5 versions - Latest release: over 1 year ago - 9 stars on GitHub
Top 6.4% on proxy.golang.org
3 versions - Latest release: 6 months ago - 7 stars on GitHub
github.com/intel-iot-devkit/rtsf-at-checkout-reference-design v3.0.0+incompatible
Detect loss at self-checkout by seamlessly connecting different sensor devices, including weight ...3 versions - Latest release: 6 months ago - 7 stars on GitHub
Top 3.6% on proxy.golang.org
42 versions - Latest release: 3 months ago - 1 dependent repositories - 20,991 stars on GitHub
github.com/google/mediapipe v0.10.10
Cross-platform, customizable ML solutions for live and streaming media.42 versions - Latest release: 3 months ago - 1 dependent repositories - 20,991 stars on GitHub
Related Keywords
deep-learning
18
machine-learning
16
ai
10
pytorch
8
llmops
8
transformer
7
golang
6
gpt
5
go
5
openvino
5
gpu
5
edge
5
llm
5
api
5
mlops
5
aistudio
4
gateway
4
generative-ai
4
llms
4
tensorrt
4
tensorflow
4
computer-vision
4
openai
4
cluster-manager
3
llama2
3
nlp
3
python
3
large-language-models
3
grpc
3
bert
3
data-parallelism
3
cloud
3
llama
3
pipeline-parallelism
3
model-parallelism
3
spn
2
probability
2
free-to-use
2
large-scale
2
hpc
2
heterogeneous-training
2
foundation-models
2
distributed-computing
2
big-model
2
roberta
2
machine-translation
2
huggingface-transformers
2
gpt2
2
decoder
2
albert
2
statistics
2
fastpathology
2
digital-pathology
2
deployment
2
cplusplus
2
convolutional-neural-networks
2
computational-pathology
2
opencl
2
opengl
2
serving
2
classification
2
dataset
2
gonum
2
csv
2
graph
2
hacktoberfest
2
image-reconstruction
2
xgboost
2
scikit-learn
2
speech-recognition
2
cpp
2
benchmarks
2
natural-language-processing
2
pgm
2
edge-computing
2
image-recognition
2
intel
2
live-demo
2
object-detection
2
nvidia
2
mixtral
2
mistral
2
pretrained-models
2
kubernetes
2
real-time
2
reference-implementation
2
video
2
model-serving
2
falcon
2
tensorboard
2
training
2
speech-to-text
2
whisper
2
datacenter
2
software
2
mlmodelscope
2
artificial-intelligence
2
edge-ai
2
deeplearning
2
mxnet
2