node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
Ecosystem
npmjs.org
npmjs.org
Latest Release
23 days ago
3.15.1
23 days ago
Versions
129
129
Downloads
1,315,933 last month
1,315,933 last month
Dependent Packages
3
3
Dependent Repos
1
1
@fallard84/langchain 0.1.37
Typescript bindings for langchain1 version - Latest release: almost 2 years ago - 10 downloads last month - 0 stars on GitHub - 1 maintainer
node-llm 1.0.0
LLMs NodeJS addon. Run your LLM easily in nodejs or electron application.1 version - Latest release: almost 2 years ago - 13 downloads last month - 0 stars on GitHub - 1 maintainer
@digitalgp/langchain-oracle 0.1.2
Typescript bindings for langchain1 version - Latest release: about 2 years ago - 4 downloads last month - 1 maintainer
@matheus-santos-souza/langchainjs-oracle-v2 1.0.2
Typescript bindings for langchain3 versions - Latest release: about 2 years ago - 16 downloads last month - 1 maintainer
@everything-registry/sub-chunk-2305 0.1.0 removed
npm install @everything-registry/sub-chunk-23051 version - Latest release: about 2 years ago - 152 stars on GitHub - 2 maintainers
@cognum-factory/langchain 0.0.1
Typescript bindings for langchain1 version - Latest release: about 2 years ago - 18 downloads last month - 0 stars on GitHub - 1 maintainer
aiconfig-extension-llama 1.1.1
## Overview3 versions - Latest release: about 2 years ago - 1 dependent package - 1 downloads last month - 1,052 stars on GitHub - 2 maintainers
@readme/langchain 0.0.181 deprecated
Typescript bindings for langchain3 versions - Latest release: over 2 years ago - 3 downloads last month - 16,076 stars on GitHub - 7 maintainers
@metalumna/langchain 0.0.154-de5c5a6
Typescript bindings for langchain10 versions - Latest release: over 2 years ago - 279 downloads last month - 11,974 stars on GitHub - 1 maintainer
Past Dependents
Include Past Dependents
Check this option to include packages that no longer depend on this package in their latest version but previously did.
Filter by Kind
Links
| Registry | npmjs.org |
| Source | Repository |
| Homepage | Homepage |
| JSON API | View JSON |
| CodeMeta | codemeta.json |
Package Details
| PURL |
pkg:npm/node-llama-cpp
spec |
| License | MIT |
| First Release | over 2 years ago |
| Last Synced | 16 days ago |
Keywords
llama llama-cpp llama.cpp bindings ai cmake cmake-js prebuilt-binaries llm gguf metal cuda vulkan grammar embedding rerank reranking json-grammar json-schema-grammar functions function-calling token-prediction speculative-decoding temperature minP topK topP seed json-schema raspberry-pi self-hosted local catai mistral deepseek qwen qwq gpt gpt-oss typescript lora batching gpu nodejs
llama llama-cpp llama.cpp bindings ai cmake cmake-js prebuilt-binaries llm gguf metal cuda vulkan grammar embedding rerank reranking json-grammar json-schema-grammar functions function-calling token-prediction speculative-decoding temperature minP topK topP seed json-schema raspberry-pi self-hosted local catai mistral deepseek qwen qwq gpt gpt-oss typescript lora batching gpu nodejs
Repository
| Stars | 1,745 on GitHub |
| Forks | 155 on GitHub |
| Commits | 174 |
| Committers | 6 |
| Avg per Author | 29.0 |
| DDS | 0.063 |
Rankings on npmjs.org
Downloads
Top 3.2%