Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

proxy.golang.org "inference" keyword

Top 1.9% on proxy.golang.org
github.com/ggerganov/whisper.cpp/bindings/go v0.0.0-20240122130235-1cf679dec4ec 💰
github.com/ggerganov/whisper.cpp/bindings/go provides a speech-to-text service bindings for the G...
315 versions - Latest release: 4 months ago - 21 dependent packages - 18 dependent repositories - 12,105 stars on GitHub
Top 3.9% on proxy.golang.org
github.com/ggerganov/whisper.cpp v1.5.5 💰
Port of OpenAI's Whisper model in C/C++
17 versions - Latest release: about 1 month ago - 1 dependent repositories - 12,105 stars on GitHub
Top 7.0% on proxy.golang.org
github.com/onepanelio/core v1.0.2
The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and autom...
56 versions - Latest release: over 2 years ago - 1 dependent package - 659 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/vllm-project/vllm v0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs
23 versions - Latest release: 14 days ago - 13,666 stars on GitHub
Top 9.1% on proxy.golang.org
github.com/missingstudio/ai v0.0.1
🌈 A Reliable AI Gateway - Core infrastructure stack for building your AI workforce
1 version - Latest release: 2 months ago - 97 stars on GitHub
Top 9.9% on proxy.golang.org
github.com/sozercan/aikit v0.8.0
🏗️ AI + BuildKit = AIKit: Build and deploy open-source LLMs easily!
14 versions - Latest release: 27 days ago - 80 stars on GitHub
Top 4.5% on proxy.golang.org
github.com/bytedance/lightseq v3.0.1+incompatible
LightSeq: A High Performance Library for Sequence Processing and Generation
13 versions - Latest release: over 1 year ago - 2,623 stars on GitHub
Top 6.4% on proxy.golang.org
github.com/patrikeh/go-topics v0.0.0-20220129155034-3523ad274ad5
Latent Dirichlet Allocation
1 version - Latest release: over 2 years ago - 25 stars on GitHub
Top 9.1% on proxy.golang.org
github.com/missingstudio/ai/gateway
🌈 A Reliable Open Source AI studio - building core infrastructure stack for LLM Applications
Latest release: 4 days ago - 26 stars on GitHub
Top 9.1% on proxy.golang.org
github.com/missingstudio/ai/protos
🌈 A Reliable Open Source AI studio - building core infrastructure stack for LLM Applications
Latest release: 4 days ago - 26 stars on GitHub
Top 9.1% on proxy.golang.org
github.com/missingstudio/ai/common
🌈 A Reliable Open Source AI studio - building core infrastructure stack for LLM Applications
Latest release: 4 days ago - 26 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/microsoft/deepspeed v0.14.2
DeepSpeed is a deep learning optimization library that makes distributed training and inference e...
85 versions - Latest release: 26 days ago - 9,602 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/Tencent/TurboTransformers v4.1.0+incompatible
a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on...
7 versions - Latest release: almost 4 years ago - 1,375 stars on GitHub
Top 5.8% on proxy.golang.org
github.com/tencent/turbotransformers v4.1.0+incompatible
a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on...
7 versions - Latest release: almost 4 years ago - 1,362 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/hpcaitech/ColossalAI v0.3.7
Making large AI models cheaper, faster and more accessible
32 versions - Latest release: 22 days ago - 36,220 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/hpcaitech/colossalai v0.3.7
Making large AI models cheaper, faster and more accessible
32 versions - Latest release: 22 days ago - 36,220 stars on GitHub
Top 6.6% on proxy.golang.org
github.com/nikolaydubina/llama2.go v0.7.1
LLaMA-2 in native Go
10 versions - Latest release: about 2 months ago - 1 dependent repositories - 121 stars on GitHub
Top 9.5% on proxy.golang.org
github.com/nikolaydubina/go-ml-benchmarks/cgo-version 💰
⏱ Benchmarks of machine learning inference for Go
Latest release: 10 days ago - 29 stars on GitHub
Top 9.5% on proxy.golang.org
github.com/nikolaydubina/go-ml-benchmarks/go-client 💰
⏱ Benchmarks of machine learning inference for Go
Latest release: 10 days ago - 29 stars on GitHub
Top 7.7% on proxy.golang.org
github.com/louisbarrett/gpt3 v1.0.2
CLI client for the OpenAI GPT-3 API in Go
3 versions - Latest release: almost 2 years ago - 3 stars on GitHub
Top 4.5% on proxy.golang.org
github.com/tobegit3hub/tensorflow_template_application v0.0.0-20210520020913-a2be179bf5e2
TensorFlow template application for deep learning
1 version - Latest release: almost 3 years ago - 1,873 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/nvidia/tensorrt v10.0.1+incompatible
NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning ...
10 versions - Latest release: 19 days ago - 6,775 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/aican-research/fast-pathology v1.1.3
⚡ Open-source software for deep learning-based digital pathology
12 versions - Latest release: about 2 months ago - 109 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/AICAN-Research/FAST-Pathology v1.1.3
⚡ Open-source software for deep learning-based digital pathology
12 versions - Latest release: about 2 months ago - 108 stars on GitHub
Top 9.7% on proxy.golang.org
github.com/rai-project/go-caffe v0.4.0
Go binding to Caffe C API to do inference with pre-trained model in Go
12 versions - Latest release: over 5 years ago - 2 dependent repositories - 5 stars on GitHub
Top 7.7% on proxy.golang.org
github.com/bhojpur/inference
The Bhojpur Inference is a software-as-a-service product used as an Inference Engine based on Bho...
Latest release: 13 days ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/h2non/filetype.py v1.2.0
Small, dependency-free, fast Python package to infer binary file types checking the magic numbers...
21 versions - Latest release: over 1 year ago - 486 stars on GitHub
Top 8.0% on proxy.golang.org
github.com/rai-project/go-mxnet v0.4.0
Go binding to MXNet C API to do inference with pre-trained model in Go
15 versions - Latest release: over 5 years ago - 2 dependent repositories - 9 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/infergo-ml/infergo v1.0.8
mirror of Infergo repository
35 versions - Latest release: almost 2 years ago - 10 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/chop-dbhi/sql-importer v0.0.0-20180819010211-3e23f1ed50ed
Import CSV files into Postgres with automatic column typing and table creation.
1 version - Latest release: over 5 years ago - 13 stars on GitHub
Top 7.6% on proxy.golang.org
github.com/rai-project/go-tensorrt v0.4.0
Go binding to TensorRT C API to do inference with pre-trained model in Go
2 versions - Latest release: over 5 years ago - 1 dependent repositories - 21 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/anskarl/lomrf v0.7.1
LoMRF is an open-source implementation of Markov Logic Networks
14 versions - Latest release: about 5 years ago - 76 stars on GitHub
Top 4.3% on proxy.golang.org
github.com/gvergnaud/ts-pattern v5.1.1+incompatible 💰
🎨 The exhaustive Pattern Matching library for TypeScript, with smart type inference.
53 versions - Latest release: about 1 month ago - 1 dependent repositories - 6,147 stars on GitHub
Top 9.8% on proxy.golang.org
github.com/huggingface/text-generation-inference v2.0.2+incompatible
Large Language Model Text Generation Inference
41 versions - Latest release: 18 days ago - 6,457 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/songtianyi/go-mxnet-predictor v0.0.0-20180606114115-81f1b9cf04f3
go binding for mxnet c_predict_api to do inference with pre-trained model
1 version - Latest release: almost 6 years ago - 55 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/CogComp/saul v0.4.1
Saul : Declarative Learning-Based Programming
1 version - Latest release: over 7 years ago - 63 stars on GitHub
Top 5.5% on proxy.golang.org
github.com/tensorchord/openmodelz/agent
One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP...
Latest release: 22 days ago - 3 dependent repositories - 146 stars on GitHub
Top 7.2% on proxy.golang.org
github.com/tensorchord/openmodelz v0.0.27
One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP...
27 versions - Latest release: 8 months ago - 146 stars on GitHub
Top 7.2% on proxy.golang.org
github.com/tensorchord/openmodelz/mdz
One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP...
Latest release: 22 days ago - 146 stars on GitHub
Top 9.0% on proxy.golang.org
github.com/leliuga/cohere-configurations v1.4.0
Co:Here Inference configurations
5 versions - Latest release: 2 months ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/RenatoGeh/gospn v0.1.0
A free, open-source inference and learning library for Sum-Product Networks (SPN)
1 version - Latest release: over 5 years ago - 23 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/renatogeh/gospn v0.1.0
A free, open-source inference and learning library for Sum-Product Networks (SPN)
1 version - Latest release: over 5 years ago - 23 stars on GitHub
Top 4.8% on proxy.golang.org
github.com/openvinotoolkit/model_server v2021.4.2+incompatible
A scalable inference server for models optimized with OpenVINO™
4 versions - Latest release: over 2 years ago - 566 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/nvidia/tensorrt-inference-server v2.44.0+incompatible
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
65 versions - Latest release: about 2 months ago - 4,958 stars on GitHub
Top 9.0% on proxy.golang.org
github.com/inferret/infer v0.0.1-pre
A declarative DSL (domain-specific language) for IDD (Inference-Driven-Development) and testing o...
1 version - Latest release: 3 months ago - 2 stars on GitHub
Top 4.4% on proxy.golang.org
github.com/triton-inference-server/server v2.44.0+incompatible
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
65 versions - Latest release: about 2 months ago - 4,932 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/intel-iot-devkit/automated-checkout v2.0.2+incompatible
Deploy sensor fusion technology for an automated checkout that enables real-time insight about th...
5 versions - Latest release: over 1 year ago - 9 stars on GitHub
Top 6.4% on proxy.golang.org
github.com/intel-iot-devkit/rtsf-at-checkout-reference-design v3.0.0+incompatible
Detect loss at self-checkout by seamlessly connecting different sensor devices, including weight ...
3 versions - Latest release: 6 months ago - 7 stars on GitHub
Top 3.6% on proxy.golang.org
github.com/google/mediapipe v0.10.10
Cross-platform, customizable ML solutions for live and streaming media.
42 versions - Latest release: 3 months ago - 1 dependent repositories - 20,991 stars on GitHub