Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
proxy.golang.org "llmops" keyword
Top 9.6% on proxy.golang.org
23 versions - Latest release: 26 days ago - 13,666 stars on GitHub
github.com/vllm-project/vllm v0.4.2
A high-throughput and memory-efficient inference and serving engine for LLMs23 versions - Latest release: 26 days ago - 13,666 stars on GitHub
Top 7.2% on proxy.golang.org
Latest release: about 1 month ago - 146 stars on GitHub
github.com/tensorchord/openmodelz/mdz
One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP...Latest release: about 1 month ago - 146 stars on GitHub
Top 5.5% on proxy.golang.org
Latest release: about 1 month ago - 3 dependent repositories - 146 stars on GitHub
github.com/tensorchord/openmodelz/agent
One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP...Latest release: about 1 month ago - 3 dependent repositories - 146 stars on GitHub
Top 7.2% on proxy.golang.org
27 versions - Latest release: 8 months ago - 146 stars on GitHub
github.com/tensorchord/openmodelz v0.0.27
One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP...27 versions - Latest release: 8 months ago - 146 stars on GitHub
Top 9.1% on proxy.golang.org
1 version - Latest release: 2 months ago - 97 stars on GitHub
github.com/missingstudio/ai v0.0.1
🌈 A Reliable AI Gateway - Core infrastructure stack for building your AI workforce1 version - Latest release: 2 months ago - 97 stars on GitHub
Top 9.0% on proxy.golang.org
Latest release: 13 days ago - 3 stars on GitHub
github.com/traceloop/go-openllmetry/sample-app
Sister project to OpenLLMetry, but in Go. Open-source observability for your LLM application, bas...Latest release: 13 days ago - 3 stars on GitHub
Top 5.2% on proxy.golang.org
42 versions - Latest release: about 1 month ago - 7,773 stars on GitHub
github.com/microsoft/autogen v0.2.27
Enable Next-Gen Large Language Model Applications. Join our Discord: https://discord.gg/pAbnFJrkgZ42 versions - Latest release: about 1 month ago - 7,773 stars on GitHub
Top 8.0% on proxy.golang.org
27 versions - Latest release: 8 months ago - 90 stars on GitHub
github.com/substratusai/substratus v0.10.1
Deploy and finetune LLMs on K8s27 versions - Latest release: 8 months ago - 90 stars on GitHub
Top 9.1% on proxy.golang.org
Latest release: 15 days ago - 26 stars on GitHub
github.com/missingstudio/ai/gateway
🌈 A Reliable Open Source AI studio - building core infrastructure stack for LLM ApplicationsLatest release: 15 days ago - 26 stars on GitHub
Top 9.1% on proxy.golang.org
Latest release: 15 days ago - 26 stars on GitHub
github.com/missingstudio/ai/protos
🌈 A Reliable Open Source AI studio - building core infrastructure stack for LLM ApplicationsLatest release: 15 days ago - 26 stars on GitHub
Top 9.1% on proxy.golang.org
Latest release: 16 days ago - 26 stars on GitHub
github.com/missingstudio/ai/common
🌈 A Reliable Open Source AI studio - building core infrastructure stack for LLM ApplicationsLatest release: 16 days ago - 26 stars on GitHub
github.com/neurocult/agency v0.3.0
🕵️♂️ Library designed for developers eager to explore the potential of Large Language Models (LL...3 versions - Latest release: about 2 months ago - 373 stars on GitHub
Top 9.0% on proxy.golang.org
277 versions - Latest release: 17 days ago - 6,661 stars on GitHub
github.com/BerriAI/litellm v1.37.9 💰
Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama,...277 versions - Latest release: 17 days ago - 6,661 stars on GitHub
Top 5.0% on proxy.golang.org
277 versions - Latest release: 17 days ago - 6,693 stars on GitHub
github.com/berriai/litellm v1.37.9 💰
Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama,...277 versions - Latest release: 17 days ago - 6,693 stars on GitHub
Top 9.3% on proxy.golang.org
Latest release: 28 days ago - 4 stars on GitHub
github.com/speakeasy-sdks/honeyhive-go-sdk
Honey Hive Go SDKLatest release: 28 days ago - 4 stars on GitHub
Related Keywords
inference
8
llm
6
generative-ai
6
ai
6
mlops
5
llms
4
gateway
4
api
4
aistudio
4
golang
3
openai
3
cluster-manager
3
gpt
3
chatgpt
2
llm-serving
2
llm-inference
2
langchain-python
2
langchain
2
anthropic
2
llm-framework
1
llama
1
kubernetes
1
kubernetes-operator
1
llm-training
1
ml-platform
1
agents
1
artificial-general-intelligence
1
artificial-intelligence
1
artificial-neural-networks
1
autonomous-agents
1
go
1
language-models
1
machine-learning
1
neural-network
1
nlp
1
rag
1
vector-database
1
sdk
1
model-serving
1
pytorch
1
transformer
1
grpc
1
large-language-models
1
protobuf
1
workforce
1
datascience
1
metrics
1
ml
1
monitoring
1
observability
1
open-source
1
open-telemetry
1
opentelemetry
1
agent-based-framework
1
agent-oriented-programming
1
chat
1
chat-application
1
chatbot
1
gpt-35-turbo
1
gpt-4
1
llm-agent
1