npmjs.org "llm-inference" keyword
View the packages on the npmjs.org package registry that are tagged with the "llm-inference" keyword.
ruvector 0.1.95
High-performance vector database for Node.js with automatic native/WASM fallback95 versions - Latest release: 5 days ago - 8.6 thousand downloads last month - 139 stars on GitHub - 1 maintainer
@ruvector/edge-net 0.5.3
Distributed compute intelligence network with WASM cryptographic security - contribute browser co...21 versions - Latest release: 5 days ago - 173 downloads last month - 139 stars on GitHub - 1 maintainer
@ruvector/router 0.1.26
Semantic router for AI agents - vector-based intent matching with HNSW indexing and SIMD accelera...3 versions - Latest release: 5 days ago - 1.48 thousand downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/sona 0.1.5
Self-Optimizing Neural Architecture (SONA) - Runtime-adaptive learning with LoRA, EWC++, and Reas...6 versions - Latest release: 5 days ago - 173 stars on GitHub - 1 maintainer
@ruvector/sona-linux-x64-gnu 0.1.5
SONA Linux x64 GNU native binding3 versions - Latest release: 5 days ago - 173 stars on GitHub - 1 maintainer
@ruvector/ruvllm 0.2.4
Self-learning LLM orchestration with SONA adaptive learning, HNSW memory, FastGRNN routing, and S...5 versions - Latest release: 5 days ago - 442 downloads last month - 74 stars on GitHub - 1 maintainer
@ruvector/rvlite 0.2.4
Standalone vector database with SQL, SPARQL, and Cypher - powered by RuVector WASM5 versions - Latest release: 26 days ago - 74 stars on GitHub - 1 maintainer
@ruvector/rudag 0.1.0
Fast DAG (Directed Acyclic Graph) library with Rust/WASM. Topological sort, critical path, task s...1 version - Latest release: 8 days ago - 90 downloads last month - 139 stars on GitHub - 1 maintainer
@ruvector/ruvllm-win32-x64-msvc 0.2.3
RuvLLM native SIMD acceleration - win32-x64-msvc (Windows) platform2 versions - Latest release: 26 days ago - 88 downloads last month - 74 stars on GitHub - 1 maintainer
@ruvector/sona-darwin-x64 0.1.5
A distributed vector database that learns. Store embeddings, query with Cypher, scale horizontall...2 versions - Latest release: 5 days ago - 44 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/tiny-dancer 0.1.15
Neural router for AI agent orchestration - FastGRNN-based intelligent routing with circuit breake...1 version - Latest release: about 1 month ago - 358 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/ruvllm-linux-arm64-gnu 0.2.3
RuvLLM native SIMD acceleration - linux-arm64-gnu platform2 versions - Latest release: 26 days ago - 252 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/ruvllm-linux-x64-gnu 0.2.3
RuvLLM native SIMD acceleration - linux-x64-gnu platform2 versions - Latest release: 26 days ago - 173 stars on GitHub - 1 maintainer
@ruvector/node-darwin-x64 0.1.18
High-performance Rust vector database for Node.js - darwin-x64 platform4 versions - Latest release: about 1 month ago - 36 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/graph-node-linux-x64-gnu 0.1.26
RuVector Graph Node.js bindings for linux-x64-gnu2 versions - Latest release: 5 days ago - 669 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/postgres-cli 0.2.6 💰
Advanced AI vector database CLI for PostgreSQL - pgvector drop-in replacement with 53+ SQL functi...10 versions - Latest release: about 1 month ago - 824 downloads last month - 74 stars on GitHub - 1 maintainer
@ruvector/edge 0.1.9
Free edge-based AI swarms in the browser - P2P, crypto, vector search, neural networks. Install @...10 versions - Latest release: 7 days ago - 173 stars on GitHub - 1 maintainer
ruvector-core-linux-x64-gnu 0.1.29
Native bindings for @ruvector/core - linux-x64-gnu platform8 versions - Latest release: 9 days ago - 2.03 thousand downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/sona-win32-arm64-msvc 0.1.5
A distributed vector database that learns. Store embeddings, query with Cypher, scale horizontall...2 versions - Latest release: 5 days ago - 158 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/tiny-dancer-wasm 0.1.0
WebAssembly bindings for Tiny Dancer - FastGRNN neural inference for AI routing in browsers1 version - Latest release: about 1 month ago - 22 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/cluster 0.1.0
Distributed clustering and coordination for RuVector - auto-sharding, Raft consensus integration1 version - Latest release: about 1 month ago - 34 downloads last month - 173 stars on GitHub - 1 maintainer
ruvector-onnx-embeddings-wasm 0.1.2
Portable WASM embedding generation with SIMD and parallel workers - run text embeddings in browse...3 versions - Latest release: 8 days ago - 546 downloads last month - 139 stars on GitHub - 1 maintainer
@ruvector/router-wasm 0.1.0
WebAssembly bindings for ruvector-router - Semantic router with HNSW vector search for browsers1 version - Latest release: about 1 month ago - 17 downloads last month - 173 stars on GitHub - 1 maintainer
ruvector-core-darwin-arm64 0.1.29
Native bindings for @ruvector/core - darwin-arm647 versions - Latest release: 9 days ago - 392 downloads last month - 139 stars on GitHub - 1 maintainer
@ruvector/gnn-darwin-arm64 0.1.19
Graph Neural Network capabilities for Ruvector - darwin-arm64 platform2 versions - Latest release: about 1 month ago - 38 downloads last month - 139 stars on GitHub - 1 maintainer
@ruvector/node-linux-arm64-gnu 0.1.18
High-performance Rust vector database for Node.js - linux-arm64-gnu platform4 versions - Latest release: about 1 month ago - 127 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/ruvllm-darwin-arm64 0.2.3
RuvLLM native SIMD acceleration - darwin-arm64 (Apple Silicon) platform2 versions - Latest release: 26 days ago - 258 downloads last month - 74 stars on GitHub - 1 maintainer
ruvllm-esp32 0.3.3
RuvLLM ESP32 - Tiny LLM inference for ESP32 microcontrollers with INT8 quantization, RAG, HNSW ve...6 versions - Latest release: 12 days ago - 701 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/agentic-synth 0.1.6 💰
High-performance synthetic data generator for AI/ML training, RAG systems, and agentic workflows ...7 versions - Latest release: about 1 month ago - 180 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/edge-full 0.1.0
Complete WASM toolkit for edge AI: vector search, graph DB, neural networks, DAG workflows, SQL/S...1 version - Latest release: 7 days ago - 139 stars on GitHub - 1 maintainer
@ruvector/graph-node-darwin-arm64 0.1.26
A distributed vector database that learns. Store embeddings, query with Cypher, scale horizontall...2 versions - Latest release: 5 days ago - 255 downloads last month - 173 stars on GitHub - 1 maintainer
@ruvector/ruvllm-darwin-x64 0.2.3
RuvLLM native SIMD acceleration - darwin-x64 (Intel Mac) platform2 versions - Latest release: 26 days ago - 168 downloads last month - 74 stars on GitHub - 1 maintainer
ruvector-core-linux-arm64-gnu 0.1.29
Native bindings for @ruvector/core - linux-arm64-gnu7 versions - Latest release: 9 days ago - 441 downloads last month - 139 stars on GitHub - 1 maintainer
@ruvector/node-win32-x64-msvc 0.1.18
High-performance Rust vector database for Node.js - win32-x64-msvc platform4 versions - Latest release: about 1 month ago - 34 downloads last month - 173 stars on GitHub - 1 maintainer
spiking-neural 1.0.1
High-performance Spiking Neural Network (SNN) with SIMD optimization - CLI & SDK2 versions - Latest release: about 1 month ago - 28 downloads last month - 173 stars on GitHub - 1 maintainer
ruvector-core-darwin-x64 0.1.29
Native bindings for @ruvector/core - darwin-x647 versions - Latest release: 9 days ago - 279 downloads last month - 139 stars on GitHub - 1 maintainer
@promptbook/markdown-utils 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books536 versions - Latest release: 7 days ago - 4.06 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/legacy-documents 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books408 versions - Latest release: 7 days ago - 4.04 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/markitdown 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books311 versions - Latest release: 7 days ago - 3.88 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/javascript 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books261 versions - Latest release: 7 days ago - 3.73 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/core 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books841 versions - Latest release: 7 days ago - 9.76 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/google 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books352 versions - Latest release: 7 days ago - 3.52 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/editable 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books339 versions - Latest release: 7 days ago - 4.04 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/fake-llm 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books589 versions - Latest release: 7 days ago - 3.92 thousand downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/documents 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books411 versions - Latest release: 7 days ago - 3.92 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/deepseek 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books308 versions - Latest release: 7 days ago - 3.95 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/cli 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books699 versions - Latest release: 7 days ago - 3.7 thousand downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/components 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books149 versions - Latest release: 7 days ago - 3.87 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/color 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books127 versions - Latest release: 7 days ago - 3.78 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@picovoice/picollm-node 2.0.0
Picovoice picoLLM Node.js binding13 versions - Latest release: 21 days ago - 208 downloads last month - 154 stars on GitHub - 7 maintainers
@picovoice/picollm-node-demo 1.3.1
Picovoice PicoLLM Node.js chat and completion demos13 versions - Latest release: 8 months ago - 11 downloads last month - 154 stars on GitHub - 7 maintainers
@empiricalrun/playwright-utils 0.38.2
Playwright utils for test code repos of our customers309 versions - Latest release: 1 day ago - 20.7 thousand downloads last month - 161 stars on GitHub - 1 maintainer
@gptp/types 0.7.15
Library to supercharge your use of large language models7 versions - Latest release: about 2 years ago - 7 downloads last month - 134 stars on GitHub - 1 maintainer
@nanocollective/nanocoder 1.20.1
A local-first CLI coding agent that brings the power of agentic coding tools like Claude Code and...36 versions - Latest release: 2 days ago - 3.02 thousand downloads last month - 929 stars on GitHub - 1 maintainer
@motesoftware/nanocoder 1.11.2 deprecated
A local-first CLI coding agent that brings the power of agentic coding tools like Claude Code and...33 versions - Latest release: 4 months ago - 85 downloads last month - 590 stars on GitHub - 2 maintainers
@yanfanvip/gpt4all 4.0.2 removed
Native Node.js LLM bindings for all.2 versions - Latest release: over 1 year ago - 3 downloads last month - 76,993 stars on GitHub - 1 maintainer
Top 2.8% on npmjs.org
10 versions - Latest release: almost 2 years ago - 4 dependent packages - 5 dependent repositories - 489 downloads last month - 70,285 stars on GitHub - 3 maintainers
gpt4all 4.0.0
Native Node.js LLM bindings for all.10 versions - Latest release: almost 2 years ago - 4 dependent packages - 5 dependent repositories - 489 downloads last month - 70,285 stars on GitHub - 3 maintainers
@empiricalrun/test-run 0.14.0
## 1. Introduction54 versions - Latest release: 3 days ago - 7.57 thousand downloads last month - 161 stars on GitHub - 1 maintainer
@empiricalrun/reporter 0.26.0
Report test results to slack and elsewhere90 versions - Latest release: 3 days ago - 2.58 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/test-gen 0.78.7
## Usage396 versions - Latest release: 3 days ago - 15.1 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/r2-uploader 0.9.0
Node.js library to upload files to R223 versions - Latest release: 3 days ago - 14.3 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@promptbook/wizard 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books177 versions - Latest release: 7 days ago - 4.37 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/vercel 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books346 versions - Latest release: 7 days ago - 5.91 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/ollama 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books191 versions - Latest release: 7 days ago - 4.2 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/pdf 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books404 versions - Latest release: 7 days ago - 4.29 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/templates 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books331 versions - Latest release: 7 days ago - 4.47 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/website-crawler 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books399 versions - Latest release: 7 days ago - 4.29 thousand downloads last month - 138 stars on GitHub - 1 maintainer
@promptbook/types 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books827 versions - Latest release: 7 days ago - 1 dependent repositories - 5.86 thousand downloads last month - 48 stars on GitHub - 1 maintainer
ptbk 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books649 versions - Latest release: 7 days ago - 3.74 thousand downloads last month - 48 stars on GitHub - 1 maintainer
promptbook 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books651 versions - Latest release: 7 days ago - 3.99 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/utils 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books829 versions - Latest release: 7 days ago - 1 dependent repositories - 3.45 million downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/remote-client 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books829 versions - Latest release: 7 days ago - 6.88 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/remote-server 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books828 versions - Latest release: 7 days ago - 1 dependent repositories - 4.77 thousand downloads last month - 7 stars on GitHub - 1 maintainer
@promptbook/openai 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books829 versions - Latest release: 7 days ago - 1 dependent repositories - 4.42 thousand downloads last month - 48 stars on GitHub - 1 maintainer
animus-client 1.21.0
Unified AI platform combining text, vision, image generation, and tools in one simple SDK. Build ...22 versions - Latest release: 7 months ago - 2.76 thousand downloads last month - 0 stars on GitHub - 1 maintainer
@promptbook/anthropic-claude 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books630 versions - Latest release: 7 days ago - 7.95 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/azure-openai 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books629 versions - Latest release: 7 days ago - 4.03 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/browser 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books512 versions - Latest release: 7 days ago - 5.15 thousand downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/node 0.104.0
Promptbook: Turn your company's scattered knowledge into AI ready books583 versions - Latest release: 7 days ago - 3.92 thousand downloads last month - 48 stars on GitHub - 1 maintainer
cactus-react-native 1.4.0
Run AI models locally on mobile devices25 versions - Latest release: 5 days ago - 1.4 thousand downloads last month - 34 stars on GitHub - 3 maintainers
@gptp/execute-javascript 0.7.15
Library to supercharge your use of large language models12 versions - Latest release: about 2 years ago - 39 downloads last month - 135 stars on GitHub - 1 maintainer
openvino-node 2025.4.0
OpenVINOâ„¢ utils for using from Node.js environment12 versions - Latest release: about 1 month ago - 2.09 thousand downloads last month - 6,310 stars on GitHub - 1 maintainer
@eko-ai/eko-extension 4.1.1
Empowering language to transform human words into action.92 versions - Latest release: 8 days ago - 1.16 thousand downloads last month - 4,746 stars on GitHub - 2 maintainers
@eko-ai/eko 4.1.0
Empowering language to transform human words into action.189 versions - Latest release: 10 days ago - 4.49 thousand downloads last month - 4,809 stars on GitHub - 2 maintainers
@fr141d2/eko 1.0.8
Empowering language to transform human words into action.1 version - Latest release: 12 months ago - 8 downloads last month - 4,746 stars on GitHub - 1 maintainer
@eko-ai/eko-nodejs 4.1.0
Empowering language to transform human words into action.90 versions - Latest release: 10 days ago - 1.36 thousand downloads last month - 4,746 stars on GitHub - 2 maintainers
@qsobad/eko 1.0.8
Empowering language to transform human words into action.1 version - Latest release: 11 months ago - 37 downloads last month - 4,640 stars on GitHub - 1 maintainer
@eko-ai/eko-web 4.1.0
Empowering language to transform human words into action.91 versions - Latest release: 10 days ago - 1.15 thousand downloads last month - 4,701 stars on GitHub - 2 maintainers
openllm_client 0.0.2
TS/JS binding for OpenLLM1 version - Latest release: over 2 years ago - 2 downloads last month - 8,657 stars on GitHub - 1 maintainer
openllm 0.0.2
TS/JS binding for OpenLLM1 version - Latest release: over 2 years ago - 2 downloads last month - 8,657 stars on GitHub - 1 maintainer
cactus-react-native-2 0.0.3 unpublished
Run AI models locally on mobile devices2 versions - Latest release: 7 months ago - 35 downloads last month - 3,397 stars on GitHub - 1 maintainer
@write-with-laika-entry-fixed/drama-engine 1.6.4
A framework for narrative agents2 versions - Latest release: 5 months ago - 16 downloads last month - 35 stars on GitHub - 1 maintainer
cactus-react-native-test 0.2.10
Run AI models locally on mobile devices2 versions - Latest release: 4 months ago - 12 downloads last month - 3,397 stars on GitHub - 2 maintainers
@cristianglezm/vue-chatbot-widget 0.0.8
[![cd](https://github.com/cristianglezm/vue-chatbot-widget/actions/workflows/cd.yml/badge.svg?bra...1 version - Latest release: 9 months ago - 8 downloads last month - 0 stars on GitHub - 1 maintainer
@promptbook/langtail 0.75.6 💰
It's time for a paradigm shift. The future of software in plain English, French or Latin305 versions - Latest release: about 1 year ago - 97 downloads last month - 48 stars on GitHub - 1 maintainer
deepinfra 2.0.2
Official API wrapper for DeepInfra1 version - Latest release: over 1 year ago - 4.22 thousand downloads last month - 15 stars on GitHub - 1 maintainer
@gptp/remote-server 0.7.15
Library to supercharge your use of large language models12 versions - Latest release: about 2 years ago - 9 downloads last month - 130 stars on GitHub - 1 maintainer
aibitat 0.0.3
An extensible, stateless and customizable framework for multi-agents conversation6 versions - Latest release: about 2 years ago - 1 dependent package - 2 downloads last month - 143 stars on GitHub - 1 maintainer
@empiricalrun/types 0.11.0
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your ap...17 versions - Latest release: over 1 year ago - 11 downloads last month - 146 stars on GitHub - 2 maintainers
@gptp/remote-client 0.7.15
Library to supercharge your use of large language models12 versions - Latest release: about 2 years ago - 14 downloads last month - 131 stars on GitHub - 1 maintainer
Related Keywords
ai
100
llm
77
machine-learning
60
natural-language-processing
53
nlp
51
openai
51
language-model
50
llmops
48
prompt
48
template
48
autogpt
48
pipeline
45
text-generation
45
rag
42
ai-agents
41
typescript
39
embeddings
39
prompt-engineering
38
workflow
38
wasm
37
browser
37
onnx
37
ocr
36
neo4j
36
low-latency
36
graph
36
gnn
36
ai-ocr
36
vector
36
rust
36
generative-ai
33
nodejs
33
chatbot
33
reasoning
32
orchestration
32
mlops
32
javascript
32
function-calling
31
workflow-engine
31
multimodal
31
large-language-models
31
ai-application-framework
31
ai-orchestration
31
ai-sdk
30
markdown-dsl
30
content-generation
30
conversational-ai
30
model-agnostic
30
multi-model
30
ai-workflow
30
natural-language
30
cross-platform
30
plain-english
30
prompt-chaining
30
prompt-management
30
prompt-template
30
task-automation
30
api-integration
30
text-processing
30
unified-interface
30
vendor-agnostic
30
cross-provider
30
developer-tools
30
automation-framework
30
ai-pipeline
30
ai-platform
30
ai-ops
30
ai-framework
30
ai-development
30
ai-automation
30
knowledge-base
30
book-language
30
human-readable
30
ai-assistant
30
ai-scripting
30
gpt-4
21
gpt-3
20
chatgpt
20
automation
16
testing
15
test-automation
14
evaluation-framework
14
testing-framework
14
vector-database
11
ruvector
11
hnsw
11
agents
10
simd
10
napi-rs
9
agent
9
neural-network
8
vector-search
7
agentic-ai
7
deep-learning
6
gpt-4o
6
gpt-4o-mini
6
o1
6
o1-mini
6
llama
6
agentic-workflow
6