Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

custom-koya-node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

Ecosystem
npmjs.org
Latest Release
0.1.0
over 1 year ago
Versions
1
Downloads
7 last month
    Loading...
    Readme
    Loading...
    Links
    Registry npmjs.org
    Source Repository
    Homepage Homepage
    JSON API View JSON
    CodeMeta codemeta.json
    Package Details
    PURL pkg:npm/custom-koya-node-llama-cpp
    spec
    License MIT
    First Release over 1 year ago
    Last Synced 6 days ago
    Keywords
    llama llama-cpp llama.cpp bindings ai cmake cmake-js prebuilt-binaries llm gguf metal cuda grammar json-grammar json-schema-grammar temperature topK topP json-schema raspberry-pi self-hosted local catai embedding function-calling gpu nodejs vulkan
    Repository
    Stars 1,719 on GitHub
    Forks 153 on GitHub
    Commits 174
    Committers 6
    Avg per Author 29.0
    DDS 0.063
    commits.ecosyste.ms
    repos.ecosyste.ms
    Funding
    https://github.com/sponsors/giladgd