Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

proxy.golang.org "llama-cpp" keyword

Top 6.7% on proxy.golang.org
github.com/withcatai/catai v3.3.0+incompatible 💰
Run AI ✨ assistant locally! with simple API for Node.js 🚀
28 versions - Latest release: 4 months ago - 477 stars on GitHub
Top 7.4% on proxy.golang.org
github.com/gotzmann/booster v1.3.3
Booster - open accelerator for LLM models. Better inference and debugging for AI hackers
3 versions - Latest release: about 2 years ago - 162 stars on GitHub
Top 1.0% on proxy.golang.org
github.com/defilantech/llmkube v0.5.1
Kubernetes operator for GPU-accelerated LLM inference - air-gapped, edge-native, production-ready
28 versions - Latest release: 8 days ago - 17 stars on GitHub
Top 8.5% on proxy.golang.org
github.com/gotzmann/llama.go v1.4.0
llama.go is like llama.cpp in pure Golang!
39 versions - Latest release: almost 3 years ago - 2 dependent packages - 1,381 stars on GitHub
Top 4.5% on proxy.golang.org
github.com/gotzmann/llama.go/ml v0.0.0-20230412160549-c20730f209a3
llama.go is like llama.cpp in pure Golang!
43 versions - Latest release: almost 3 years ago - 2 dependent packages - 1 dependent repositories - 1,381 stars on GitHub
github.com/gotzmann/llama.go/llama v0.0.0-20230412160549-c20730f209a3
llama.go is like llama.cpp in pure Golang!
41 versions - Latest release: almost 3 years ago - 1 dependent package - 1,381 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/withcatai/node-llama-cpp 💰
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema ...
99 versions - 1,719 stars on GitHub
Top 5.3% on proxy.golang.org
github.com/docker/compose-for-agents/langchaingo
Build and run AI agents using Docker Compose. A collection of ready-to-use examples for orchestra...
Latest release: 3 months ago - 561 stars on GitHub
Top 9.9% on proxy.golang.org
github.com/gotzmann/llamazoo v1.3.3
Large Model Collider - The Platform for serving LLM models
4 versions - Latest release: about 2 years ago - 44 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/greynewell/musegpt v0.1.0 💰
Local LLMs in your DAW!
2 versions - Latest release: about 1 month ago - 63 stars on GitHub
Top 9.9% on proxy.golang.org
github.com/gotzmann/collider v1.3.3
Large Model Collider - The Platform for serving LLM models
7 versions - Latest release: about 2 years ago - 44 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/phronmophobic/llama.clj v0.9.0 💰
Run LLMs locally. A clojure wrapper for llama.cpp.
6 versions - Latest release: 3 months ago - 172 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/SciSharp/LLamaSharp v0.26.0
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
27 versions - Latest release: about 1 month ago - 3,370 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/scisharp/llamasharp v0.26.0
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
27 versions - Latest release: about 1 month ago - 3,370 stars on GitHub
github.com/bdqfork/go-llama.cpp v0.0.0-20230611165138-807312fddea3
go binding for llama.cpp, offer low level and high level api
1 version - Latest release: almost 3 years ago - 6 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/mybigday/llama.rn v0.11.4
React Native binding of llama.cpp
140 versions - Latest release: 16 days ago - 703 stars on GitHub
Top 6.5% on proxy.golang.org
github.com/gpustack/gguf-parser-go v0.24.0
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
113 versions - Latest release: about 1 month ago - 197 stars on GitHub
Top 5.4% on proxy.golang.org
github.com/lordmathis/llamactl v0.15.2
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
29 versions - Latest release: 21 days ago - 43 stars on GitHub
Top 5.9% on proxy.golang.org
github.com/mobile-artificial-intelligence/maid v3.0.0+incompatible 💰
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and wi...
9 versions - Latest release: about 1 month ago - 2,194 stars on GitHub
Top 5.9% on proxy.golang.org
github.com/Mobile-Artificial-Intelligence/maid v3.0.0+incompatible 💰
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and wi...
9 versions - Latest release: about 1 month ago - 2,198 stars on GitHub
Top 6.5% on proxy.golang.org
github.com/gpustack/gguf-parser-go/cmd/gguf-parser
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
Latest release: about 2 months ago - 197 stars on GitHub
Top 5.5% on proxy.golang.org
github.com/thushan/olla v0.0.24 💰
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing,...
19 versions - Latest release: about 1 month ago - 105 stars on GitHub
Related Keywords
llm 15 llama 14 llamacpp 11 chatgpt 10 gpt 9 gguf 7 vicuna 6 openai 6 ai 5 chatbot 5 alpaca 5 vllm 5 llama2 4 self-hosted 4 ollama 4 dalai 4 wizardlm 3 exllama 3 ggml 3 gpt4all 3 gpt4 3 go 3 android 3 oobabooga 3 gpt3 3 large-language-models 3 llm-inference 2 llm-router 2 catai 2 mlx 2 android-ai 2 facebook 2 nodejs 2 stable-diffusion-cpp 2 llama-box 2 koboldai 2 open-assistant 2 stablelm 2 semantic-kernel 2 multi-modal 2 llava 2 llama3 2 local-llm 2 openorca 2 mobile-artificial-intelligence 2 mobile-ai 2 mistral 2 nvidia 2 flutter 2 local-ai 2 free-chatgpt 2 vllm-backend 1 llm-routing 1 lmstudio 1 proxy 1 self-hosted-ai 1 ios 1 react-native 1 llm-proxy 1 intel 1 golang 1 amd 1 sglang 1 openai-api 1 llama-server 1 mlx-lm 1 localllama 1 localllm 1 cuda 1 cmake-js 1 cmake 1 bindings 1 operator 1 mlops 1 machine-learning 1 kubernetes-operator 1 kubernetes 1 inference 1 gpu 1 edge-computing 1 edge-ai 1 vicuna-installation-guide 1 node-llama-cpp 1 localai 1 ggmlv3 1 chatui 1 ai-assistant 1 clojure 1 vst3 1 vst-plugin 1 vst 1 music-production 1 juce-plugins 1 juce 1 daw 1 ai-music 1 openai-gym 1 examples 1 docker-compose 1 docker 1