npmjs.org "speculative-decoding" keyword
View the packages on the npmjs.org package registry that are tagged with the "speculative-decoding" keyword.
node-llama-cpp 3.7.0 💰
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema ...111 versions - Latest release: 30 days ago - 3 dependent packages - 1 dependent repositories - 35.5 thousand downloads last month - 1,409 stars on GitHub - 1 maintainer
Related Keywords
llama
1
llama-cpp
1
llama.cpp
1
bindings
1
ai
1
cmake
1
cmake-js
1
prebuilt-binaries
1
llm
1
gguf
1
metal
1
cuda
1
vulkan
1
grammar
1
embedding
1
rerank
1
reranking
1
json-grammar
1
json-schema-grammar
1
functions
1
function-calling
1
token-prediction
1
temperature
1
minP
1
topK
1
topP
1
seed
1
json-schema
1
raspberry-pi
1
self-hosted
1
local
1
catai
1
mistral
1
deepseek
1
qwen
1
qwq
1
typescript
1
lora
1
batching
1
gpu
1
nodejs
1