Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

npmjs.org "efficient-inference" keyword

View the packages on the npmjs.org package registry that are tagged with the "efficient-inference" keyword.

@picovoice/picollm-node 1.3.1
Picovoice picoLLM Node.js binding
12 versions - Latest release: 5 months ago - 26 downloads last month - 154 stars on GitHub - 7 maintainers
@picovoice/picollm-node-demo 1.3.1
Picovoice PicoLLM Node.js chat and completion demos
13 versions - Latest release: 5 months ago - 1 downloads last month - 154 stars on GitHub - 7 maintainers
Related Keywords
node 2 ai 2 offline 2 llm 2 compression 2 gemma 2 generative-ai 2 language-model 2 language-models 2 large-language-model 2 llama 2 llama2 2 llama3 2 llm-inference 2 llms 2 mistral 2 mixtral 2 model-compression 2 natural-language-processing 2 quantization 2 self-hosted 2