node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
Ecosystem
npmjs.org
npmjs.org
Latest Release
24 days ago
3.15.1
24 days ago
Versions
129
129
Downloads
1,315,933 last month
1,315,933 last month
Dependent Packages
3
3
Dependent Repos
1
1
giladgd
49 packages6,423,321 downloads
Links
| Registry | npmjs.org |
| Source | Repository |
| Homepage | Homepage |
| JSON API | View JSON |
| CodeMeta | codemeta.json |
Package Details
| PURL |
pkg:npm/node-llama-cpp
spec |
| License | MIT |
| First Release | over 2 years ago |
| Last Synced | 16 days ago |
Keywords
llama llama-cpp llama.cpp bindings ai cmake cmake-js prebuilt-binaries llm gguf metal cuda vulkan grammar embedding rerank reranking json-grammar json-schema-grammar functions function-calling token-prediction speculative-decoding temperature minP topK topP seed json-schema raspberry-pi self-hosted local catai mistral deepseek qwen qwq gpt gpt-oss typescript lora batching gpu nodejs
llama llama-cpp llama.cpp bindings ai cmake cmake-js prebuilt-binaries llm gguf metal cuda vulkan grammar embedding rerank reranking json-grammar json-schema-grammar functions function-calling token-prediction speculative-decoding temperature minP topK topP seed json-schema raspberry-pi self-hosted local catai mistral deepseek qwen qwq gpt gpt-oss typescript lora batching gpu nodejs
Repository
| Stars | 1,745 on GitHub |
| Forks | 155 on GitHub |
| Commits | 174 |
| Committers | 6 |
| Avg per Author | 29.0 |
| DDS | 0.063 |
Rankings on npmjs.org
Downloads
Top 3.2%