node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
Ecosystem
npmjs.org
npmjs.org
Latest Release
18 days ago
3.16.1
18 days ago
Versions
131
131
Downloads
3,436,450 last month
3,436,450 last month
Dependent Packages
3
3
Dependent Repos
1
1
create-llama-cpp-node 0.1.0 💰
Scaffold a new llama-cpp-node project from a template1 version - Latest release: 7 days ago - 1 maintainer
@llama-cpp-node/win-x64-vulkan 0.1.0
Prebuilt binary for llama-cpp-node for Windows x64 with Vulkan support1 version - Latest release: 7 days ago - 1 maintainer
@llama-cpp-node/win-x64-cuda-ext 0.1.0
Extension of @llama-cpp-node/win-x64-cuda - prebuilt binary for llama-cpp-node for Windows x64 wi...1 version - Latest release: 7 days ago - 1 maintainer
@llama-cpp-node/win-x64-cuda 0.1.0
Prebuilt binary for llama-cpp-node for Windows x64 with CUDA support1 version - Latest release: 7 days ago - 1 maintainer
@llama-cpp-node/win-x64 0.1.0
Prebuilt binary for llama-cpp-node for Windows x641 version - Latest release: 7 days ago - 1 maintainer
@llama-cpp-node/win-arm64 0.1.0
Prebuilt binary for llama-cpp-node for Windows arm641 version - Latest release: 7 days ago - 1 maintainer
@llama-cpp-node/mac-x64 0.1.0
Prebuilt binary for llama-cpp-node for macOS x641 version - Latest release: 7 days ago - 88 downloads last month - 1 maintainer
@llama-cpp-node/mac-arm64-metal 0.1.0
Prebuilt binary for llama-cpp-node for macOS arm64 with Metal support1 version - Latest release: 7 days ago - 1 maintainer
@llama-cpp-node/linux-x64-vulkan 0.1.0
Prebuilt binary for llama-cpp-node for Linux x64 with Vulkan support1 version - Latest release: 7 days ago - 1 maintainer
@llama-cpp-node/linux-x64-cuda-ext 0.1.0
Extension of @llama-cpp-node/linux-x64-cuda - prebuilt binary for llama-cpp-node for Linux x64 wi...1 version - Latest release: 7 days ago - 1 maintainer
@llama-cpp-node/linux-x64-cuda 0.1.0
Prebuilt binary for llama-cpp-node for Linux x64 with CUDA support1 version - Latest release: 7 days ago - 1 maintainer
@llama-cpp-node/linux-x64 0.1.0
Prebuilt binary for llama-cpp-node for Linux x641 version - Latest release: 7 days ago - 1 maintainer
@llama-cpp-node/linux-armv7l 0.1.0
Prebuilt binary for llama-cpp-node for Linux armv7l1 version - Latest release: 7 days ago - 1 maintainer
@llama-cpp-node/linux-arm64 0.1.0
Prebuilt binary for llama-cpp-node for Linux arm641 version - Latest release: 7 days ago - 1 maintainer
@node-llama-cpp/win-x64-vulkan 3.17.1 💰
Prebuilt binary for node-llama-cpp for Windows x64 with Vulkan support44 versions - Latest release: 11 days ago - 3.38 thousand downloads last month - 1,719 stars on GitHub - 1 maintainer
@node-llama-cpp/win-x64-cuda 3.17.1 💰
Prebuilt binary for node-llama-cpp for Windows x64 with CUDA support56 versions - Latest release: 11 days ago - 895 thousand downloads last month - 1,729 stars on GitHub - 1 maintainer
@node-llama-cpp/win-x64 3.17.1 💰
Prebuilt binary for node-llama-cpp for Windows x6444 versions - Latest release: 11 days ago - 240 thousand downloads last month - 1,729 stars on GitHub - 1 maintainer
@node-llama-cpp/win-arm64 3.17.1 💰
Prebuilt binary for node-llama-cpp for Windows arm6444 versions - Latest release: 11 days ago - 239 thousand downloads last month - 1,719 stars on GitHub - 1 maintainer
@node-llama-cpp/mac-x64 3.17.1 💰
Prebuilt binary for node-llama-cpp for macOS x6444 versions - Latest release: 11 days ago - 186 thousand downloads last month - 1,914 stars on GitHub - 1 maintainer
@node-llama-cpp/mac-arm64-metal 3.17.1 💰
Prebuilt binary for node-llama-cpp for macOS arm64 with Metal support44 versions - Latest release: 11 days ago - 854 thousand downloads last month - 1,719 stars on GitHub - 1 maintainer
@node-llama-cpp/linux-x64-vulkan 3.17.1 💰
Prebuilt binary for node-llama-cpp for Linux x64 with Vulkan support44 versions - Latest release: 11 days ago - 21.2 thousand downloads last month - 1,719 stars on GitHub - 1 maintainer
@node-llama-cpp/linux-x64-cuda 3.17.1 💰
Prebuilt binary for node-llama-cpp for Linux x64 with CUDA support56 versions - Latest release: 11 days ago - 21.7 thousand downloads last month - 1,776 stars on GitHub - 1 maintainer
@node-llama-cpp/linux-x64 3.17.1 💰
Prebuilt binary for node-llama-cpp for Linux x6445 versions - Latest release: 11 days ago - 674 thousand downloads last month - 1,719 stars on GitHub - 1 maintainer
@node-llama-cpp/linux-armv7l 3.17.1 💰
Prebuilt binary for node-llama-cpp for Linux armv7l45 versions - Latest release: 11 days ago - 672 thousand downloads last month - 1,776 stars on GitHub - 1 maintainer
@node-llama-cpp/linux-arm64 3.17.1 💰
Prebuilt binary for node-llama-cpp for Linux arm6445 versions - Latest release: 11 days ago - 22.3 thousand downloads last month - 1,776 stars on GitHub - 1 maintainer
@node-llama-cpp/linux-x64-cuda-ext 3.17.1 💰
Extension of @node-llama-cpp/linux-x64-cuda - prebuilt binary for node-llama-cpp for Linux x64 wi...17 versions - Latest release: 11 days ago - 686 thousand downloads last month - 1,719 stars on GitHub - 1 maintainer
@node-llama-cpp/win-x64-cuda-ext 3.17.1 💰
Extension of @node-llama-cpp/win-x64-cuda - prebuilt binary for node-llama-cpp for Windows x64 wi...17 versions - Latest release: 11 days ago - 2.23 thousand downloads last month - 1,719 stars on GitHub - 1 maintainer
create-node-llama-cpp 3.16.1 💰
Scaffold a new node-llama-cpp project from a template60 versions - Latest release: 18 days ago - 351 downloads last month - 1,719 stars on GitHub - 1 maintainer
@plugos-org/node-llama-cpp-android-arm64 3.15.1-0
Prebuilt binary for node-llama-cpp for Android arm641 version - Latest release: 30 days ago - 1 maintainer
@plugos-org/node-llama-cpp 3.15.1 💰
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema ...2 versions - Latest release: 30 days ago - 1 maintainer
@aibrow/node-llama-cpp-win-x64-vulkan 1.7.0 💰
Prebuilt binary for node-llama-cpp for Windows x64 with Vulkan support14 versions - Latest release: 8 months ago - 14 downloads last month - 1,719 stars on GitHub - 2 maintainers
@aibrow/node-llama-cpp-win-x64-cuda 1.7.0 💰
Prebuilt binary for node-llama-cpp for Windows x64 with CUDA support14 versions - Latest release: 8 months ago - 23 downloads last month - 1,719 stars on GitHub - 2 maintainers
@aibrow/node-llama-cpp-win-x64 1.7.0 💰
Prebuilt binary for node-llama-cpp for Windows x6414 versions - Latest release: 8 months ago - 540 downloads last month - 1,719 stars on GitHub - 2 maintainers
@aibrow/node-llama-cpp-win-arm64 1.7.0 💰
Prebuilt binary for node-llama-cpp for Windows arm6414 versions - Latest release: 8 months ago - 90 downloads last month - 1,729 stars on GitHub - 2 maintainers
@aibrow/node-llama-cpp-mac-x64 1.7.0 💰
Prebuilt binary for node-llama-cpp for macOS x6414 versions - Latest release: 8 months ago - 637 downloads last month - 1,719 stars on GitHub - 2 maintainers
@aibrow/node-llama-cpp-mac-arm64-metal 1.7.0 💰
Prebuilt binary for node-llama-cpp for macOS arm64 with Metal support14 versions - Latest release: 8 months ago - 31 downloads last month - 1,719 stars on GitHub - 2 maintainers
@aibrow/node-llama-cpp-linux-x64-vulkan 1.7.0 💰
Prebuilt binary for node-llama-cpp for Linux x64 with Vulkan support14 versions - Latest release: 8 months ago - 27 downloads last month - 1,719 stars on GitHub - 2 maintainers
@aibrow/node-llama-cpp-linux-x64-cuda 1.7.0 💰
Prebuilt binary for node-llama-cpp for Linux x64 with CUDA support14 versions - Latest release: 8 months ago - 14 downloads last month - 1,719 stars on GitHub - 2 maintainers
@aibrow/node-llama-cpp-linux-x64 1.7.0 💰
Prebuilt binary for node-llama-cpp for Linux x6414 versions - Latest release: 8 months ago - 19 downloads last month - 1,719 stars on GitHub - 2 maintainers
@aibrow/node-llama-cpp-linux-armv7l 1.7.0 💰
Prebuilt binary for node-llama-cpp for Linux armv7l14 versions - Latest release: 8 months ago - 13 downloads last month - 1,719 stars on GitHub - 2 maintainers
@aibrow/node-llama-cpp-linux-arm64 1.7.0 💰
Prebuilt binary for node-llama-cpp for Linux arm6414 versions - Latest release: 8 months ago - 9 downloads last month - 1,719 stars on GitHub - 2 maintainers
@aibrow/create-node-llama-cpp 1.3.3 💰
Scaffold a new node-llama-cpp project from a template5 versions - Latest release: 10 months ago - 13 downloads last month - 1,719 stars on GitHub - 2 maintainers
custom-koya-node-llama-cpp 0.1.0 💰
Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on...1 version - Latest release: over 1 year ago - 7 downloads last month - 1,719 stars on GitHub - 1 maintainer
Links
| Registry | npmjs.org |
| Source | Repository |
| Homepage | Homepage |
| JSON API | View JSON |
| CodeMeta | codemeta.json |
Package Details
| PURL |
pkg:npm/node-llama-cpp
spec |
| License | MIT |
| First Release | over 2 years ago |
| Last Synced | 18 days ago |
Keywords
llama llama-cpp llama.cpp bindings ai cmake cmake-js prebuilt-binaries llm gguf metal cuda vulkan grammar embedding rerank reranking json-grammar json-schema-grammar functions function-calling token-prediction speculative-decoding temperature minP topK topP seed xtc json-schema raspberry-pi self-hosted local catai mistral deepseek qwen qwq gpt gpt-oss typescript lora batching gpu nodejs
llama llama-cpp llama.cpp bindings ai cmake cmake-js prebuilt-binaries llm gguf metal cuda vulkan grammar embedding rerank reranking json-grammar json-schema-grammar functions function-calling token-prediction speculative-decoding temperature minP topK topP seed xtc json-schema raspberry-pi self-hosted local catai mistral deepseek qwen qwq gpt gpt-oss typescript lora batching gpu nodejs
Repository
| Stars | 1,745 on GitHub |
| Forks | 155 on GitHub |
| Commits | 174 |
| Committers | 6 |
| Avg per Author | 29.0 |
| DDS | 0.063 |
Rankings on npmjs.org
Downloads
Top 3.2%