An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

npmjs.org "llm-inference" keyword

View the packages on the npmjs.org package registry that are tagged with the "llm-inference" keyword.

@promptbook/core 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
744 versions - Latest release: 23 days ago - 17.2 thousand downloads last month - 130 stars on GitHub - 1 maintainer
ptbk 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
556 versions - Latest release: 23 days ago - 4.15 thousand downloads last month - 48 stars on GitHub - 1 maintainer
promptbook 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
558 versions - Latest release: 23 days ago - 4.28 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/website-crawler 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
305 versions - Latest release: 23 days ago - 3.76 thousand downloads last month - 130 stars on GitHub - 1 maintainer
@promptbook/utils 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
734 versions - Latest release: 23 days ago - 1 dependent repositories - 3.51 million downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/types 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
733 versions - Latest release: 23 days ago - 1 dependent repositories - 14 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/wizard 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
83 versions - Latest release: 23 days ago - 3.14 thousand downloads last month - 130 stars on GitHub - 1 maintainer
@promptbook/vercel 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
252 versions - Latest release: 23 days ago - 4.3 thousand downloads last month - 130 stars on GitHub - 1 maintainer
@promptbook/templates 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
237 versions - Latest release: 23 days ago - 3.46 thousand downloads last month - 130 stars on GitHub - 1 maintainer
@promptbook/remote-server 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
734 versions - Latest release: 23 days ago - 1 dependent repositories - 5.38 thousand downloads last month - 7 stars on GitHub - 1 maintainer
@promptbook/openai 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
735 versions - Latest release: 23 days ago - 1 dependent repositories - 5.11 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/remote-client 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
735 versions - Latest release: 23 days ago - 13.8 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/pdf 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
310 versions - Latest release: 23 days ago - 3.68 thousand downloads last month - 130 stars on GitHub - 1 maintainer
@promptbook/node 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
490 versions - Latest release: 23 days ago - 15.3 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/markdown-utils 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
440 versions - Latest release: 23 days ago - 3.87 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/markitdown 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
215 versions - Latest release: 23 days ago - 3.43 thousand downloads last month - 130 stars on GitHub - 1 maintainer
@promptbook/ollama 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
97 versions - Latest release: 23 days ago - 3.12 thousand downloads last month - 130 stars on GitHub - 1 maintainer
@promptbook/fake-llm 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
493 versions - Latest release: 23 days ago - 3.83 thousand downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/legacy-documents 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
312 versions - Latest release: 23 days ago - 3.58 thousand downloads last month - 130 stars on GitHub - 1 maintainer
@promptbook/google 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
256 versions - Latest release: 23 days ago - 3.28 thousand downloads last month - 130 stars on GitHub - 1 maintainer
@promptbook/javascript 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
165 versions - Latest release: 23 days ago - 3.18 thousand downloads last month - 130 stars on GitHub - 1 maintainer
@promptbook/editable 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
242 versions - Latest release: 23 days ago - 3.32 thousand downloads last month - 130 stars on GitHub - 1 maintainer
@promptbook/documents 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
314 versions - Latest release: 23 days ago - 3.42 thousand downloads last month - 130 stars on GitHub - 1 maintainer
@promptbook/deepseek 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
211 versions - Latest release: 23 days ago - 3.31 thousand downloads last month - 130 stars on GitHub - 1 maintainer
@promptbook/components 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
52 versions - Latest release: 23 days ago - 3.04 thousand downloads last month - 130 stars on GitHub - 1 maintainer
@promptbook/color 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
30 versions - Latest release: 23 days ago - 2.8 thousand downloads last month - 130 stars on GitHub - 1 maintainer
@promptbook/cli 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
602 versions - Latest release: 23 days ago - 3.65 thousand downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/azure-openai 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
535 versions - Latest release: 23 days ago - 3.52 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/browser 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
418 versions - Latest release: 23 days ago - 5.32 thousand downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/anthropic-claude 0.100.2
Promptbook: Run AI apps in plain human language across multiple models and platforms
536 versions - Latest release: 23 days ago - 9.32 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@gptp/types 0.7.15
Library to supercharge your use of large language models
7 versions - Latest release: almost 2 years ago - 5 downloads last month - 130 stars on GitHub - 1 maintainer
Top 2.8% on npmjs.org
gpt4all 4.0.0
Native Node.js LLM bindings for all.
10 versions - Latest release: over 1 year ago - 4 dependent packages - 5 dependent repositories - 1.18 thousand downloads last month - 70,285 stars on GitHub - 3 maintainers
openllm_client 0.0.2
TS/JS binding for OpenLLM
1 version - Latest release: over 2 years ago - 0 downloads last month - 8,657 stars on GitHub - 1 maintainer
@yanfanvip/gpt4all 4.0.2 removed
Native Node.js LLM bindings for all.
2 versions - Latest release: over 1 year ago - 3 downloads last month - 76,706 stars on GitHub - 1 maintainer
openllm 0.0.2
TS/JS binding for OpenLLM
1 version - Latest release: over 2 years ago - 3 downloads last month - 8,657 stars on GitHub - 1 maintainer
@picovoice/picollm-node 1.3.1
Picovoice picoLLM Node.js binding
12 versions - Latest release: 5 months ago - 36 downloads last month - 154 stars on GitHub - 7 maintainers
@picovoice/picollm-node-demo 1.3.1
Picovoice PicoLLM Node.js chat and completion demos
13 versions - Latest release: 5 months ago - 16 downloads last month - 154 stars on GitHub - 7 maintainers
@gptp/parser 0.7.0
Library to supercharge your use of large language models
2 versions - Latest release: almost 2 years ago - 13 downloads last month - 130 stars on GitHub - 1 maintainer
@motesoftware/nanocoder 1.11.2 deprecated
A local-first CLI coding agent that brings the power of agentic coding tools like Claude Code and...
33 versions - Latest release: 9 days ago - 1.63 thousand downloads last month - 504 stars on GitHub - 2 maintainers
cactus-react-native-2 0.0.3 unpublished
Run AI models locally on mobile devices
2 versions - Latest release: 4 months ago - 35 downloads last month - 3,362 stars on GitHub - 1 maintainer
cactus-react-native-test 0.2.10
Run AI models locally on mobile devices
2 versions - Latest release: about 1 month ago - 95 downloads last month - 3,362 stars on GitHub - 1 maintainer
cactus-react-native 0.2.10
Run AI models locally on mobile devices
18 versions - Latest release: about 1 month ago - 413 downloads last month - 3,011 stars on GitHub - 1 maintainer
@eko-ai/eko-web 3.0.9
Empowering language to transform human words into action.
70 versions - Latest release: 8 days ago - 1.06 thousand downloads last month - 4,616 stars on GitHub - 3 maintainers
@eko-ai/eko-nodejs 3.0.9
Empowering language to transform human words into action.
70 versions - Latest release: 8 days ago - 1.13 thousand downloads last month - 4,616 stars on GitHub - 3 maintainers
@eko-ai/eko-extension 3.0.9
Empowering language to transform human words into action.
70 versions - Latest release: 8 days ago - 1 thousand downloads last month - 4,616 stars on GitHub - 3 maintainers
@eko-ai/eko 3.0.9
Empowering language to transform human words into action.
160 versions - Latest release: 8 days ago - 2.81 thousand downloads last month - 4,616 stars on GitHub - 3 maintainers
openvino-node 2025.3.0
OpenVINO™ utils for using from Node.js environment
11 versions - Latest release: 29 days ago - 2.06 thousand downloads last month - 6,310 stars on GitHub - 1 maintainer
@empiricalrun/fetch 0.3.1
This module provides a fetch instance wrapper designed to handle retries and timeouts seamlessly....
3 versions - Latest release: over 1 year ago - 10 downloads last month - 146 stars on GitHub - 2 maintainers
empiricalrun 0.14.0
[![npm](https://img.shields.io/npm/v/empiricalrun)](https://npmjs.com/package/empiricalrun) [![Di...
5 versions - Latest release: over 1 year ago - 3 downloads last month - 146 stars on GitHub - 2 maintainers
create-empiricalrun 0.1.1
Setup your empiricalrun project effortlessly.
2 versions - Latest release: over 1 year ago - 0 downloads last month - 146 stars on GitHub - 1 maintainer
@empiricalrun/scorer 0.4.0
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your ap...
18 versions - Latest release: over 1 year ago - 29 downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/ai 0.10.1
SDK for calling different LLM APIs using OpenAI format
15 versions - Latest release: over 1 year ago - 25 downloads last month - 146 stars on GitHub - 2 maintainers
animus-client 1.21.0
Unified AI platform combining text, vision, image generation, and tools in one simple SDK. Build ...
22 versions - Latest release: 4 months ago - 36 downloads last month - 0 stars on GitHub - 1 maintainer
@promptbook/gemini 0.76.0 💰
It's time for a paradigm shift. The future of software in plain English, French or Latin
2 versions - Latest release: 10 months ago - 16 downloads last month - 130 stars on GitHub - 1 maintainer
@promptbook/mock 0.55.0 deprecated 💰
Library to supercharge your use of large language models
72 versions - Latest release: over 1 year ago - 52 downloads last month - 43 stars on GitHub - 1 maintainer
@promptbook/wizzard 0.94.0
Promptbook: Run AI apps in plain human language across multiple models and platforms
361 versions - Latest release: 4 months ago - 1 dependent repositories - 91 downloads last month - 43 stars on GitHub - 1 maintainer
@promptbook/execute-javascript 0.86.31 deprecated
It's time for a paradigm shift. The future of software in plain English, French or Latin
574 versions - Latest release: 7 months ago - 457 downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/langtail 0.75.6 💰
It's time for a paradigm shift. The future of software in plain English, French or Latin
305 versions - Latest release: 10 months ago - 65 downloads last month - 48 stars on GitHub - 1 maintainer
@qsobad/eko 1.0.8
Empowering language to transform human words into action.
1 version - Latest release: 8 months ago - 20 downloads last month - 4,580 stars on GitHub - 1 maintainer
@fr141d2/eko 1.0.8
Empowering language to transform human words into action.
1 version - Latest release: 8 months ago - 3 downloads last month - 4,580 stars on GitHub - 1 maintainer
deepinfra 2.0.2
Official API wrapper for DeepInfra
1 version - Latest release: over 1 year ago - 3.11 thousand downloads last month - 15 stars on GitHub - 1 maintainer
resk-llm-ts 0.9.1
A TypeScript library for secure LLM interactions.
6 versions - Latest release: 19 days ago - 27 downloads last month - 7 stars on GitHub - 1 maintainer
@gptp/remote-server 0.7.15
Library to supercharge your use of large language models
12 versions - Latest release: almost 2 years ago - 1 downloads last month - 128 stars on GitHub - 1 maintainer
@cristianglezm/vue-chatbot-widget 0.0.8
[![cd](https://github.com/cristianglezm/vue-chatbot-widget/actions/workflows/cd.yml/badge.svg?bra...
1 version - Latest release: 6 months ago - 5 downloads last month - 0 stars on GitHub - 1 maintainer
@gptp/execute-javascript 0.7.15
Library to supercharge your use of large language models
12 versions - Latest release: almost 2 years ago - 0 downloads last month - 128 stars on GitHub - 1 maintainer
@write-with-laika-entry-fixed/drama-engine 1.6.4
A framework for narrative agents
2 versions - Latest release: about 2 months ago - 53 downloads last month - 35 stars on GitHub - 1 maintainer
@empiricalrun/playwright-utils 0.28.7
Playwright utils for test code repos of our customers
292 versions - Latest release: 25 days ago - 5.53 thousand downloads last month - 160 stars on GitHub - 1 maintainer
llm-runner-router 1.0.0
Universal LLM model loader and inference router - agnostic, fast, and intelligent
1 version - Latest release: about 2 months ago - 70 downloads last month - 1 stars on GitHub - 1 maintainer
@empiricalrun/test-gen 0.76.0
## Usage
387 versions - Latest release: 25 days ago - 5.59 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/reporter 0.25.3
Report test results to slack and elsewhere
88 versions - Latest release: 25 days ago - 3.57 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@gaiaverse/semantic-turning-point-detector 4.0.0
Detects key semantic turning points in conversations using recursive semantic distance analysis. ...
17 versions - Latest release: about 2 months ago - 63 downloads last month - 3 stars on GitHub - 2 maintainers
@gptp/remote-client 0.7.15
Library to supercharge your use of large language models
12 versions - Latest release: almost 2 years ago - 1 downloads last month - 126 stars on GitHub - 1 maintainer
aibitat 0.0.3
An extensible, stateless and customizable framework for multi-agents conversation
6 versions - Latest release: almost 2 years ago - 1 dependent package - 11 downloads last month - 143 stars on GitHub - 1 maintainer
@gptp/executor 0.7.0
Library to supercharge your use of large language models
2 versions - Latest release: almost 2 years ago - 1 downloads last month - 126 stars on GitHub - 1 maintainer
@gptp/callback-prompt 0.7.0
Library to supercharge your use of large language models
2 versions - Latest release: almost 2 years ago - 3 downloads last month - 126 stars on GitHub - 1 maintainer
@gptp/simple-prompt 0.7.0
Library to supercharge your use of large language models
2 versions - Latest release: almost 2 years ago - 2 downloads last month - 126 stars on GitHub - 1 maintainer
@gptp/wizzard 0.7.15
Library to supercharge your use of large language models
12 versions - Latest release: almost 2 years ago - 5 downloads last month - 126 stars on GitHub - 1 maintainer
@empiricalrun/test-run 0.11.1
## 1. Introduction
49 versions - Latest release: 29 days ago - 7.52 thousand downloads last month - 160 stars on GitHub - 1 maintainer
@write-with-laika/drama-engine 1.6.3
A framework for narrative agents
26 versions - Latest release: about 1 year ago - 41 downloads last month - 36 stars on GitHub - 2 maintainers
@gptp/mock 0.7.0
Library to supercharge your use of large language models
2 versions - Latest release: almost 2 years ago - 1 downloads last month - 126 stars on GitHub - 1 maintainer
@empiricalrun/r2-uploader 0.3.11
Node.js library to upload files to R2
17 versions - Latest release: 29 days ago - 4.89 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/llm 0.22.0
Package to connect and trace LLM calls.
104 versions - Latest release: 29 days ago - 6.86 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@gptp/openai 0.7.15
Library to supercharge your use of large language models
12 versions - Latest release: almost 2 years ago - 10 downloads last month - 126 stars on GitHub - 1 maintainer
@gptp/core 0.7.15
Library to supercharge your use of large language models
24 versions - Latest release: almost 2 years ago - 165 downloads last month - 120 stars on GitHub - 1 maintainer
@browserai/browserai 2.0.4
A library for running AI models directly in the browser
43 versions - Latest release: 4 months ago - 54 downloads last month - 1,185 stars on GitHub - 2 maintainers
@gptp/utils 0.7.15
Library to supercharge your use of large language models
12 versions - Latest release: almost 2 years ago - 6 downloads last month - 126 stars on GitHub - 1 maintainer
@duck4i/llama 0.3.0
Native Node.JS plugin to run LLAMA inference directly on your machine with no other dependencies.
14 versions - Latest release: 9 months ago - 17 downloads last month - 0 stars on GitHub - 1 maintainer
@empiricalrun/types 0.11.0
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your ap...
17 versions - Latest release: over 1 year ago - 1 downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/core 0.8.2
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your ap...
20 versions - Latest release: over 1 year ago - 0 downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/cli 0.12.1 deprecated
[![npm](https://img.shields.io/npm/v/@empiricalrun/cli)](https://npmjs.com/package/@empiricalrun/...
26 versions - Latest release: over 1 year ago - 0 downloads last month - 146 stars on GitHub - 2 maintainers
Related Keywords
llm 65 ai 63 natural-language-processing 52 openai 50 language-model 50 nlp 49 machine-learning 49 autogpt 48 llmops 48 prompt 48 template 48 text-generation 45 pipeline 44 ai-agents 39 rag 37 prompt-engineering 37 typescript 36 workflow 36 chatbot 33 generative-ai 33 javascript 32 mlops 32 embeddings 32 orchestration 32 ai-orchestration 31 ai-application-framework 31 large-language-models 31 function-calling 31 nodejs 31 multimodal 31 browser 31 reasoning 31 vendor-agnostic 30 workflow-engine 30 unified-interface 30 plain-english 30 text-processing 30 prompt-chaining 30 prompt-management 30 prompt-template 30 task-automation 30 ai-assistant 30 ai-automation 30 ai-development 30 ai-framework 30 ai-ops 30 ai-pipeline 30 ai-platform 30 ai-scripting 30 ai-sdk 30 ai-workflow 30 api-integration 30 automation-framework 30 book-language 30 content-generation 30 conversational-ai 30 cross-platform 30 cross-provider 30 developer-tools 30 human-readable 30 knowledge-base 30 markdown-dsl 30 model-agnostic 30 multi-model 30 natural-language 30 gpt-4 21 gpt-3 20 chatgpt 20 automation 16 testing 15 testing-framework 14 test-automation 14 evaluation-framework 14 agents 10 agent 8 agentic-workflow 6 agentic-framework 6 agentic-ai-development 6 agentic-ai 6 anthropic 6 gpt-4o 6 gpt-4o-mini 6 o1 6 o1-mini 6 o1-preview 6 eko 6 fellou 6 llama 6 natural-language-inference 6 llmapi 6 llm-agents 6 genai 6 computeruse 6 computer-automation 6 chain-of-thought 6 browseruse 6 browser-automation 6 llms 5 mistral 5 llamacpp 4