proxy.golang.org : github.com/withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
Registry
-
Source
- Documentation
- JSON
- codemeta.json
purl: pkg:golang/github.com/withcatai/node-llama-cpp
Keywords:
ai
, bindings
, catai
, cmake
, cmake-js
, cuda
, gguf
, grammar
, json-schema
, llama
, llama-cpp
, llm
, metal
, nodejs
, prebuilt-binaries
, self-hosted
License:
First release: over 2 years ago
Stars: 1,719 on GitHub
Forks: 153 on GitHub
Total Commits: 174
Committers: 6
Average commits per author: 29.0
Development Distribution Score (DDS): 0.063
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Funding links: https://github.com/sponsors/giladgd
Last synced: over 1 year ago