npmjs.org "speculative-decoding" keyword
@realtimex/node-llama-cpp 0.3.1 💰
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema ...5 versions - Latest release: 2 days ago - 173 downloads last month - 0 stars on GitHub - 1 maintainer
@aibrow/node-llama-cpp 1.7.0 💰
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema ...12 versions - Latest release: 9 months ago - 395 downloads last month - 0 stars on GitHub - 2 maintainers
hail-hydra-cc 2.0.4
Multi-headed speculative execution framework for Claude Code11 versions - Latest release: 18 days ago - 1.04 thousand downloads last month - 35 stars on GitHub - 1 maintainer
node-llama-cpp 3.18.0 💰
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema ...135 versions - Latest release: 24 days ago - 3 dependent packages - 1 dependent repositories - 3.44 million downloads last month - 1,745 stars on GitHub - 1 maintainer
@plugos-org/node-llama-cpp 3.15.1 💰
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema ...2 versions - Latest release: about 2 months ago - 1 maintainer
Related Keywords
ai
5
llama
4
token-prediction
4
temperature
4
minP
4
topK
4
topP
4
seed
4
json-schema
4
raspberry-pi
4
self-hosted
4
local
4
catai
4
mistral
4
deepseek
4
qwen
4
qwq
4
typescript
4
lora
4
batching
4
gpu
4
llama-cpp
4
llama.cpp
4
bindings
4
cmake
4
cmake-js
4
prebuilt-binaries
4
llm
4
gguf
4
metal
4
function-calling
4
functions
4
json-schema-grammar
4
json-grammar
4
reranking
4
rerank
4
embedding
4
grammar
4
vulkan
4
cuda
4
gpt
3
gpt-oss
3
xtc
2
claude-code-agents
1
context-engineering
1
haiku
1
hail-hydra
1
meta-prompting
1
multi-agent-collaboration
1
opus
1
sonnet
1
nodejs
1
ai-framwork
1
ai-agents-framework
1
ai-agent
1
anthropic
1
hydra
1
multi-agent
1
speculative-execution
1
claude
1
claude-code
1