An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

npmjs.org "llm-inference" keyword

View the packages on the npmjs.org package registry that are tagged with the "llm-inference" keyword.

ruvector 0.1.95
High-performance vector database for Node.js with automatic native/WASM fallback
95 versions - Latest release: 5 days ago - 8.6 thousand downloads last month - 139 stars on GitHub - 1 maintainer
@ruvector/edge-net 0.5.3
Distributed compute intelligence network with WASM cryptographic security - contribute browser co...
21 versions - Latest release: 5 days ago - 173 downloads last month - 139 stars on GitHub - 1 maintainer
@ruvector/router 0.1.26
Semantic router for AI agents - vector-based intent matching with HNSW indexing and SIMD accelera...
3 versions - Latest release: 5 days ago - 1.48 thousand downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/sona 0.1.5
Self-Optimizing Neural Architecture (SONA) - Runtime-adaptive learning with LoRA, EWC++, and Reas...
6 versions - Latest release: 5 days ago - 173 stars on GitHub - 1 maintainer
@ruvector/sona-linux-x64-gnu 0.1.5
SONA Linux x64 GNU native binding
3 versions - Latest release: 5 days ago - 173 stars on GitHub - 1 maintainer
@ruvector/ruvllm 0.2.4
Self-learning LLM orchestration with SONA adaptive learning, HNSW memory, FastGRNN routing, and S...
5 versions - Latest release: 5 days ago - 442 downloads last month - 74 stars on GitHub - 1 maintainer
@ruvector/rvlite 0.2.4
Standalone vector database with SQL, SPARQL, and Cypher - powered by RuVector WASM
5 versions - Latest release: 26 days ago - 74 stars on GitHub - 1 maintainer
@ruvector/rudag 0.1.0
Fast DAG (Directed Acyclic Graph) library with Rust/WASM. Topological sort, critical path, task s...
1 version - Latest release: 8 days ago - 90 downloads last month - 139 stars on GitHub - 1 maintainer
@ruvector/ruvllm-win32-x64-msvc 0.2.3
RuvLLM native SIMD acceleration - win32-x64-msvc (Windows) platform
2 versions - Latest release: 26 days ago - 88 downloads last month - 74 stars on GitHub - 1 maintainer
@ruvector/sona-darwin-x64 0.1.5
A distributed vector database that learns. Store embeddings, query with Cypher, scale horizontall...
2 versions - Latest release: 5 days ago - 44 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/tiny-dancer 0.1.15
Neural router for AI agent orchestration - FastGRNN-based intelligent routing with circuit breake...
1 version - Latest release: about 1 month ago - 358 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/ruvllm-linux-arm64-gnu 0.2.3
RuvLLM native SIMD acceleration - linux-arm64-gnu platform
2 versions - Latest release: 26 days ago - 252 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/ruvllm-linux-x64-gnu 0.2.3
RuvLLM native SIMD acceleration - linux-x64-gnu platform
2 versions - Latest release: 26 days ago - 173 stars on GitHub - 1 maintainer
@ruvector/node-darwin-x64 0.1.18
High-performance Rust vector database for Node.js - darwin-x64 platform
4 versions - Latest release: about 1 month ago - 36 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/graph-node-linux-x64-gnu 0.1.26
RuVector Graph Node.js bindings for linux-x64-gnu
2 versions - Latest release: 5 days ago - 669 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/postgres-cli 0.2.6 💰
Advanced AI vector database CLI for PostgreSQL - pgvector drop-in replacement with 53+ SQL functi...
10 versions - Latest release: about 1 month ago - 824 downloads last month - 74 stars on GitHub - 1 maintainer
@ruvector/edge 0.1.9
Free edge-based AI swarms in the browser - P2P, crypto, vector search, neural networks. Install @...
10 versions - Latest release: 7 days ago - 173 stars on GitHub - 1 maintainer
ruvector-core-linux-x64-gnu 0.1.29
Native bindings for @ruvector/core - linux-x64-gnu platform
8 versions - Latest release: 9 days ago - 2.03 thousand downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/sona-win32-arm64-msvc 0.1.5
A distributed vector database that learns. Store embeddings, query with Cypher, scale horizontall...
2 versions - Latest release: 5 days ago - 158 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/tiny-dancer-wasm 0.1.0
WebAssembly bindings for Tiny Dancer - FastGRNN neural inference for AI routing in browsers
1 version - Latest release: about 1 month ago - 22 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/cluster 0.1.0
Distributed clustering and coordination for RuVector - auto-sharding, Raft consensus integration
1 version - Latest release: about 1 month ago - 34 downloads last month - 173 stars on GitHub - 1 maintainer
ruvector-onnx-embeddings-wasm 0.1.2
Portable WASM embedding generation with SIMD and parallel workers - run text embeddings in browse...
3 versions - Latest release: 8 days ago - 546 downloads last month - 139 stars on GitHub - 1 maintainer
@ruvector/router-wasm 0.1.0
WebAssembly bindings for ruvector-router - Semantic router with HNSW vector search for browsers
1 version - Latest release: about 1 month ago - 17 downloads last month - 173 stars on GitHub - 1 maintainer
ruvector-core-darwin-arm64 0.1.29
Native bindings for @ruvector/core - darwin-arm64
7 versions - Latest release: 9 days ago - 392 downloads last month - 139 stars on GitHub - 1 maintainer
@ruvector/gnn-darwin-arm64 0.1.19
Graph Neural Network capabilities for Ruvector - darwin-arm64 platform
2 versions - Latest release: about 1 month ago - 38 downloads last month - 139 stars on GitHub - 1 maintainer
@ruvector/node-linux-arm64-gnu 0.1.18
High-performance Rust vector database for Node.js - linux-arm64-gnu platform
4 versions - Latest release: about 1 month ago - 127 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/ruvllm-darwin-arm64 0.2.3
RuvLLM native SIMD acceleration - darwin-arm64 (Apple Silicon) platform
2 versions - Latest release: 26 days ago - 258 downloads last month - 74 stars on GitHub - 1 maintainer
ruvllm-esp32 0.3.3
RuvLLM ESP32 - Tiny LLM inference for ESP32 microcontrollers with INT8 quantization, RAG, HNSW ve...
6 versions - Latest release: 12 days ago - 701 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/agentic-synth 0.1.6 💰
High-performance synthetic data generator for AI/ML training, RAG systems, and agentic workflows ...
7 versions - Latest release: about 1 month ago - 180 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/edge-full 0.1.0
Complete WASM toolkit for edge AI: vector search, graph DB, neural networks, DAG workflows, SQL/S...
1 version - Latest release: 7 days ago - 139 stars on GitHub - 1 maintainer
@ruvector/graph-node-darwin-arm64 0.1.26
A distributed vector database that learns. Store embeddings, query with Cypher, scale horizontall...
2 versions - Latest release: 5 days ago - 255 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/ruvllm-darwin-x64 0.2.3
RuvLLM native SIMD acceleration - darwin-x64 (Intel Mac) platform
2 versions - Latest release: 26 days ago - 168 downloads last month - 74 stars on GitHub - 1 maintainer
ruvector-core-linux-arm64-gnu 0.1.29
Native bindings for @ruvector/core - linux-arm64-gnu
7 versions - Latest release: 9 days ago - 441 downloads last month - 139 stars on GitHub - 1 maintainer
@ruvector/node-win32-x64-msvc 0.1.18
High-performance Rust vector database for Node.js - win32-x64-msvc platform
4 versions - Latest release: about 1 month ago - 34 downloads last month - 173 stars on GitHub - 1 maintainer
spiking-neural 1.0.1
High-performance Spiking Neural Network (SNN) with SIMD optimization - CLI & SDK
2 versions - Latest release: about 1 month ago - 28 downloads last month - 173 stars on GitHub - 1 maintainer
ruvector-core-darwin-x64 0.1.29
Native bindings for @ruvector/core - darwin-x64
7 versions - Latest release: 9 days ago - 279 downloads last month - 139 stars on GitHub - 1 maintainer
@promptbook/markdown-utils 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
536 versions - Latest release: 7 days ago - 4.06 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/legacy-documents 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
408 versions - Latest release: 7 days ago - 4.04 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/markitdown 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
311 versions - Latest release: 7 days ago - 3.88 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/javascript 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
261 versions - Latest release: 7 days ago - 3.73 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/core 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
841 versions - Latest release: 7 days ago - 9.76 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/google 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
352 versions - Latest release: 7 days ago - 3.52 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/editable 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
339 versions - Latest release: 7 days ago - 4.04 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/fake-llm 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
589 versions - Latest release: 7 days ago - 3.92 thousand downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/documents 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
411 versions - Latest release: 7 days ago - 3.92 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/deepseek 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
308 versions - Latest release: 7 days ago - 3.95 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/cli 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
699 versions - Latest release: 7 days ago - 3.7 thousand downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/components 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
149 versions - Latest release: 7 days ago - 3.87 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/color 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
127 versions - Latest release: 7 days ago - 3.78 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@picovoice/picollm-node 2.0.0
Picovoice picoLLM Node.js binding
13 versions - Latest release: 21 days ago - 208 downloads last month - 154 stars on GitHub - 7 maintainers
@picovoice/picollm-node-demo 1.3.1
Picovoice PicoLLM Node.js chat and completion demos
13 versions - Latest release: 8 months ago - 11 downloads last month - 154 stars on GitHub - 7 maintainers
@empiricalrun/playwright-utils 0.38.2
Playwright utils for test code repos of our customers
309 versions - Latest release: 1 day ago - 20.7 thousand downloads last month - 161 stars on GitHub - 1 maintainer
@gptp/types 0.7.15
Library to supercharge your use of large language models
7 versions - Latest release: about 2 years ago - 7 downloads last month - 134 stars on GitHub - 1 maintainer
@nanocollective/nanocoder 1.20.1
A local-first CLI coding agent that brings the power of agentic coding tools like Claude Code and...
36 versions - Latest release: 2 days ago - 3.02 thousand downloads last month - 929 stars on GitHub - 1 maintainer
@motesoftware/nanocoder 1.11.2 deprecated
A local-first CLI coding agent that brings the power of agentic coding tools like Claude Code and...
33 versions - Latest release: 4 months ago - 85 downloads last month - 590 stars on GitHub - 2 maintainers
@yanfanvip/gpt4all 4.0.2 removed
Native Node.js LLM bindings for all.
2 versions - Latest release: over 1 year ago - 3 downloads last month - 76,993 stars on GitHub - 1 maintainer
Top 2.8% on npmjs.org
gpt4all 4.0.0
Native Node.js LLM bindings for all.
10 versions - Latest release: almost 2 years ago - 4 dependent packages - 5 dependent repositories - 489 downloads last month - 70,285 stars on GitHub - 3 maintainers
@empiricalrun/test-run 0.14.0
## 1. Introduction
54 versions - Latest release: 3 days ago - 7.57 thousand downloads last month - 161 stars on GitHub - 1 maintainer
@empiricalrun/reporter 0.26.0
Report test results to slack and elsewhere
90 versions - Latest release: 3 days ago - 2.58 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/test-gen 0.78.7
## Usage
396 versions - Latest release: 3 days ago - 15.1 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/r2-uploader 0.9.0
Node.js library to upload files to R2
23 versions - Latest release: 3 days ago - 14.3 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@promptbook/wizard 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
177 versions - Latest release: 7 days ago - 4.37 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/vercel 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
346 versions - Latest release: 7 days ago - 5.91 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/ollama 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
191 versions - Latest release: 7 days ago - 4.2 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/pdf 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
404 versions - Latest release: 7 days ago - 4.29 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/templates 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
331 versions - Latest release: 7 days ago - 4.47 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/website-crawler 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
399 versions - Latest release: 7 days ago - 4.29 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/types 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
827 versions - Latest release: 7 days ago - 1 dependent repositories - 5.86 thousand downloads last month - 48 stars on GitHub - 1 maintainer
ptbk 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
649 versions - Latest release: 7 days ago - 3.74 thousand downloads last month - 48 stars on GitHub - 1 maintainer
promptbook 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
651 versions - Latest release: 7 days ago - 3.99 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/utils 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
829 versions - Latest release: 7 days ago - 1 dependent repositories - 3.45 million downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/remote-client 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
829 versions - Latest release: 7 days ago - 6.88 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/remote-server 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
828 versions - Latest release: 7 days ago - 1 dependent repositories - 4.77 thousand downloads last month - 7 stars on GitHub - 1 maintainer
@promptbook/openai 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
829 versions - Latest release: 7 days ago - 1 dependent repositories - 4.42 thousand downloads last month - 48 stars on GitHub - 1 maintainer
animus-client 1.21.0
Unified AI platform combining text, vision, image generation, and tools in one simple SDK. Build ...
22 versions - Latest release: 7 months ago - 2.76 thousand downloads last month - 0 stars on GitHub - 1 maintainer
@promptbook/anthropic-claude 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
630 versions - Latest release: 7 days ago - 7.95 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/azure-openai 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
629 versions - Latest release: 7 days ago - 4.03 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/browser 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
512 versions - Latest release: 7 days ago - 5.15 thousand downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/node 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books
583 versions - Latest release: 7 days ago - 3.92 thousand downloads last month - 48 stars on GitHub - 1 maintainer
cactus-react-native 1.4.0
Run AI models locally on mobile devices
25 versions - Latest release: 5 days ago - 1.4 thousand downloads last month - 34 stars on GitHub - 3 maintainers
@gptp/execute-javascript 0.7.15
Library to supercharge your use of large language models
12 versions - Latest release: about 2 years ago - 39 downloads last month - 135 stars on GitHub - 1 maintainer
openvino-node 2025.4.0
OpenVINOâ„¢ utils for using from Node.js environment
12 versions - Latest release: about 1 month ago - 2.09 thousand downloads last month - 6,310 stars on GitHub - 1 maintainer
@eko-ai/eko-extension 4.1.1
Empowering language to transform human words into action.
92 versions - Latest release: 8 days ago - 1.16 thousand downloads last month - 4,746 stars on GitHub - 2 maintainers
@eko-ai/eko 4.1.0
Empowering language to transform human words into action.
189 versions - Latest release: 10 days ago - 4.49 thousand downloads last month - 4,809 stars on GitHub - 2 maintainers
@fr141d2/eko 1.0.8
Empowering language to transform human words into action.
1 version - Latest release: 12 months ago - 8 downloads last month - 4,746 stars on GitHub - 1 maintainer
@eko-ai/eko-nodejs 4.1.0
Empowering language to transform human words into action.
90 versions - Latest release: 10 days ago - 1.36 thousand downloads last month - 4,746 stars on GitHub - 2 maintainers
@qsobad/eko 1.0.8
Empowering language to transform human words into action.
1 version - Latest release: 11 months ago - 37 downloads last month - 4,640 stars on GitHub - 1 maintainer
@eko-ai/eko-web 4.1.0
Empowering language to transform human words into action.
91 versions - Latest release: 10 days ago - 1.15 thousand downloads last month - 4,701 stars on GitHub - 2 maintainers
openllm_client 0.0.2
TS/JS binding for OpenLLM
1 version - Latest release: over 2 years ago - 2 downloads last month - 8,657 stars on GitHub - 1 maintainer
openllm 0.0.2
TS/JS binding for OpenLLM
1 version - Latest release: over 2 years ago - 2 downloads last month - 8,657 stars on GitHub - 1 maintainer
cactus-react-native-2 0.0.3 unpublished
Run AI models locally on mobile devices
2 versions - Latest release: 7 months ago - 35 downloads last month - 3,397 stars on GitHub - 1 maintainer
@write-with-laika-entry-fixed/drama-engine 1.6.4
A framework for narrative agents
2 versions - Latest release: 5 months ago - 16 downloads last month - 35 stars on GitHub - 1 maintainer
cactus-react-native-test 0.2.10
Run AI models locally on mobile devices
2 versions - Latest release: 4 months ago - 12 downloads last month - 3,397 stars on GitHub - 2 maintainers
@cristianglezm/vue-chatbot-widget 0.0.8
[![cd](https://github.com/cristianglezm/vue-chatbot-widget/actions/workflows/cd.yml/badge.svg?bra...
1 version - Latest release: 9 months ago - 8 downloads last month - 0 stars on GitHub - 1 maintainer
@promptbook/langtail 0.75.6 💰
It's time for a paradigm shift. The future of software in plain English, French or Latin
305 versions - Latest release: about 1 year ago - 97 downloads last month - 48 stars on GitHub - 1 maintainer
deepinfra 2.0.2
Official API wrapper for DeepInfra
1 version - Latest release: over 1 year ago - 4.22 thousand downloads last month - 15 stars on GitHub - 1 maintainer
@gptp/remote-server 0.7.15
Library to supercharge your use of large language models
12 versions - Latest release: about 2 years ago - 9 downloads last month - 130 stars on GitHub - 1 maintainer
aibitat 0.0.3
An extensible, stateless and customizable framework for multi-agents conversation
6 versions - Latest release: about 2 years ago - 1 dependent package - 2 downloads last month - 143 stars on GitHub - 1 maintainer
@empiricalrun/types 0.11.0
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your ap...
17 versions - Latest release: over 1 year ago - 11 downloads last month - 146 stars on GitHub - 2 maintainers
@gptp/remote-client 0.7.15
Library to supercharge your use of large language models
12 versions - Latest release: about 2 years ago - 14 downloads last month - 131 stars on GitHub - 1 maintainer