npmjs.org "speculative-decoding" keyword
@aibrow/node-llama-cpp 1.7.0 💰
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema ...12 versions - Latest release: 8 months ago - 395 downloads last month - 0 stars on GitHub - 2 maintainers
node-llama-cpp 3.16.1 💰
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema ...131 versions - Latest release: 18 days ago - 3 dependent packages - 1 dependent repositories - 3.44 million downloads last month - 1,745 stars on GitHub - 1 maintainer
@plugos-org/node-llama-cpp 3.15.1 💰
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema ...2 versions - Latest release: 29 days ago - 1 maintainer
Related Keywords
function-calling
3
token-prediction
3
temperature
3
minP
3
topK
3
topP
3
seed
3
json-schema
3
raspberry-pi
3
self-hosted
3
local
3
catai
3
mistral
3
deepseek
3
qwen
3
qwq
3
typescript
3
lora
3
batching
3
gpu
3
llama
3
llama-cpp
3
llama.cpp
3
bindings
3
ai
3
cmake
3
cmake-js
3
prebuilt-binaries
3
llm
3
gguf
3
metal
3
cuda
3
vulkan
3
grammar
3
embedding
3
rerank
3
reranking
3
json-grammar
3
json-schema-grammar
3
functions
3
gpt
2
gpt-oss
2
xtc
1
nodejs
1