npmjs.org : node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Registry - Source - Homepage - JSON - codemeta.json
purl: pkg:npm/node-llama-cpp
Keywords: llama , llama-cpp , llama.cpp , bindings , ai , cmake , cmake-js , prebuilt-binaries , llm , gguf , metal , cuda , vulkan , grammar , embedding , rerank , reranking , json-grammar , json-schema-grammar , functions , function-calling , token-prediction , speculative-decoding , temperature , minP , topK , topP , seed , json-schema , raspberry-pi , self-hosted , local , catai , mistral , deepseek , qwen , qwq , gpt , gpt-oss , typescript , lora , batching , gpu , nodejs
License: MIT
Latest release: 21 days ago
First release: over 2 years ago
Dependent packages: 3
Dependent repositories: 1
Downloads: 48,924 last month
Stars: 1,745 on GitHub
Forks: 155 on GitHub
Total Commits: 174
Committers: 6
Average commits per author: 29.0
Development Distribution Score (DDS): 0.063
More commit stats: commits.ecosyste.ms
See more repository details: repos.ecosyste.ms
Funding links: https://github.com/sponsors/giladgd
Last synced: 1 day ago

• Readme
• Versions 124
• Dependent Packages 3
• Maintainers 1
• Related Packages 27
• Sort

  • Name
  • Versions
  • Latest Release
  • Oldest Release
  • Dependent packages
  • Dependent repositories
  • Downloads
  • Maintainers
  • Most Stars
  • Least Stars