`github.com/withcatai/node-llama-cpp`

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Ecosystem
proxy.golang.org

Versions
99

No dependent packages found.

Check this option to include packages that no longer depend on this package in their latest version but previously did.

PURL	`pkg:golang/github.com/withcatai/node-llama-cpp` spec
License
First Release	over 2 years ago
Last Synced	5 days ago

Keywords
ai bindings catai cmake cmake-js cuda gguf grammar json-schema llama llama-cpp llm metal nodejs prebuilt-binaries self-hosted

commits.ecosyste.ms

repos.ecosyste.ms

Overall Top 6.7%

ecosyste.ms