npmjs.org "llm-inference" keyword
View the packages on the npmjs.org package registry that are tagged with the "llm-inference" keyword.
@eko-ai/eko 1.3.0
Empowering language to transform human words into action.60 versions - Latest release: about 10 hours ago - 2.03 thousand downloads last month - 2,943 stars on GitHub - 3 maintainers
@promptbook/core 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin613 versions - Latest release: 8 days ago - 23.6 thousand downloads last month - 109 stars on GitHub - 1 maintainer
Top 2.8% on npmjs.org
10 versions - Latest release: about 1 year ago - 4 dependent packages - 5 dependent repositories - 718 downloads last month - 70,285 stars on GitHub - 3 maintainers
gpt4all 4.0.0
Native Node.js LLM bindings for all.10 versions - Latest release: about 1 year ago - 4 dependent packages - 5 dependent repositories - 718 downloads last month - 70,285 stars on GitHub - 3 maintainers
@yanfanvip/gpt4all 4.0.2 removed
Native Node.js LLM bindings for all.2 versions - Latest release: 12 months ago - 3 downloads last month - 63,563 stars on GitHub - 1 maintainer
@promptbook/javascript 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin34 versions - Latest release: 8 days ago - 2.05 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/editable 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin111 versions - Latest release: 8 days ago - 2.15 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/documents 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin183 versions - Latest release: 8 days ago - 2.17 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/google 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin125 versions - Latest release: 8 days ago - 2.17 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/gemini 0.76.0 💰
It's time for a paradigm shift. The future of software in plain English, French or Latin2 versions - Latest release: 5 months ago - 8 downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/deepseek 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin79 versions - Latest release: 8 days ago - 2.1 thousand downloads last month - 109 stars on GitHub - 1 maintainer
promptbook 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin430 versions - Latest release: 8 days ago - 3.17 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/utils 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin607 versions - Latest release: 8 days ago - 1 dependent repositories - 2.64 million downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/fake-llm 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin362 versions - Latest release: 8 days ago - 2.36 thousand downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/cli 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin469 versions - Latest release: 8 days ago - 2.49 thousand downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/anthropic-claude 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin401 versions - Latest release: 8 days ago - 2.41 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/azure-openai 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin401 versions - Latest release: 8 days ago - 2.45 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/browser 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin284 versions - Latest release: 8 days ago - 2.32 thousand downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/execute-javascript 0.86.31 deprecated
It's time for a paradigm shift. The future of software in plain English, French or Latin574 versions - Latest release: about 2 months ago - 533 downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/mock 0.55.0 deprecated 💰
Library to supercharge your use of large language models72 versions - Latest release: 10 months ago - 268 downloads last month - 43 stars on GitHub - 1 maintainer
@promptbook/langtail 0.75.6 💰
It's time for a paradigm shift. The future of software in plain English, French or Latin305 versions - Latest release: 5 months ago - 973 downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/website-crawler 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin177 versions - Latest release: 8 days ago - 2.22 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/templates 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin108 versions - Latest release: 8 days ago - 2.08 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/legacy-documents 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin181 versions - Latest release: 8 days ago - 2.15 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/pdf 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin180 versions - Latest release: 8 days ago - 2.21 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/markitdown 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin84 versions - Latest release: 8 days ago - 2.09 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/vercel 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin124 versions - Latest release: 8 days ago - 2.16 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/types 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin604 versions - Latest release: 8 days ago - 1 dependent repositories - 4.05 thousand downloads last month - 48 stars on GitHub - 1 maintainer
ptbk 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin428 versions - Latest release: 8 days ago - 3.04 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/remote-client 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin605 versions - Latest release: 8 days ago - 2.71 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/openai 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin605 versions - Latest release: 8 days ago - 1 dependent repositories - 2.61 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/remote-server 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin604 versions - Latest release: 8 days ago - 1 dependent repositories - 2.73 thousand downloads last month - 7 stars on GitHub - 1 maintainer
@promptbook/node 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin359 versions - Latest release: 8 days ago - 2.34 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/wizzard 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin316 versions - Latest release: 8 days ago - 1 dependent repositories - 2.34 thousand downloads last month - 43 stars on GitHub - 1 maintainer
@promptbook/markdown-utils 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin309 versions - Latest release: 8 days ago - 2.62 thousand downloads last month - 48 stars on GitHub - 1 maintainer
openllm_client 0.0.2
TS/JS binding for OpenLLM1 version - Latest release: almost 2 years ago - 6 downloads last month - 8,657 stars on GitHub - 1 maintainer
openllm 0.0.2
TS/JS binding for OpenLLM1 version - Latest release: almost 2 years ago - 6 downloads last month - 8,657 stars on GitHub - 1 maintainer
@gptp/remote-server 0.7.15
Library to supercharge your use of large language models12 versions - Latest release: over 1 year ago - 58 downloads last month - 109 stars on GitHub - 1 maintainer
@empiricalrun/playwright-utils 0.25.25
Playwright utils for test code repos of our customers242 versions - Latest release: 3 days ago - 5.67 thousand downloads last month - 156 stars on GitHub - 1 maintainer
@empiricalrun/test-gen 0.53.12
## Usage337 versions - Latest release: 3 days ago - 5.83 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/llm 0.14.7
Package to connect and trace LLM calls.79 versions - Latest release: 3 days ago - 4.77 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@picovoice/picollm-node-demo 1.3.0
Picovoice PicoLLM Node.js chat and completion demos12 versions - Latest release: about 1 month ago - 35 downloads last month - 154 stars on GitHub - 7 maintainers
@picovoice/picollm-node 1.3.0
Picovoice picoLLM Node.js binding11 versions - Latest release: about 1 month ago - 71 downloads last month - 154 stars on GitHub - 7 maintainers
@write-with-laika/drama-engine 1.6.3
A framework for narrative agents26 versions - Latest release: 7 months ago - 172 downloads last month - 33 stars on GitHub - 2 maintainers
@fr141d2/eko 1.0.8
Empowering language to transform human words into action.1 version - Latest release: 3 months ago - 43 downloads last month - 2,943 stars on GitHub - 1 maintainer
@qsobad/eko 1.0.8
Empowering language to transform human words into action.1 version - Latest release: 3 months ago - 48 downloads last month - 2,943 stars on GitHub - 1 maintainer
openvino-node 2025.1.0
OpenVINOâ„¢ utils for using from Node.js environment9 versions - Latest release: 13 days ago - 8.93 thousand downloads last month - 6,310 stars on GitHub - 1 maintainer
@gptp/execute-javascript 0.7.15
Library to supercharge your use of large language models12 versions - Latest release: over 1 year ago - 67 downloads last month - 109 stars on GitHub - 1 maintainer
@gptp/utils 0.7.15
Library to supercharge your use of large language models12 versions - Latest release: over 1 year ago - 75 downloads last month - 109 stars on GitHub - 1 maintainer
@gptp/parser 0.7.0
Library to supercharge your use of large language models2 versions - Latest release: over 1 year ago - 15 downloads last month - 109 stars on GitHub - 1 maintainer
@duck4i/llama 0.3.0
Native Node.JS plugin to run LLAMA inference directly on your machine with no other dependencies.14 versions - Latest release: 3 months ago - 48 downloads last month - 0 stars on GitHub - 1 maintainer
@gptp/simple-prompt 0.7.0
Library to supercharge your use of large language models2 versions - Latest release: over 1 year ago - 16 downloads last month - 109 stars on GitHub - 1 maintainer
@gptp/mock 0.7.0
Library to supercharge your use of large language models2 versions - Latest release: over 1 year ago - 13 downloads last month - 109 stars on GitHub - 1 maintainer
@browserai/browserai 2.0.1
A library for running AI models directly in the browser40 versions - Latest release: 21 days ago - 533 downloads last month - 1,021 stars on GitHub - 2 maintainers
@gptp/executor 0.7.0
Library to supercharge your use of large language models2 versions - Latest release: over 1 year ago - 10 downloads last month - 109 stars on GitHub - 1 maintainer
@empiricalrun/reporter 0.23.4
Report test results to slack and elsewhere82 versions - Latest release: 12 days ago - 2.66 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/test-run 0.7.6
## 1. Introduction25 versions - Latest release: 27 days ago - 2.99 thousand downloads last month - 155 stars on GitHub - 1 maintainer
create-empiricalrun 0.1.1
Setup your empiricalrun project effortlessly.2 versions - Latest release: 11 months ago - 8 downloads last month - 146 stars on GitHub - 1 maintainer
@empiricalrun/fetch 0.3.1
This module provides a fetch instance wrapper designed to handle retries and timeouts seamlessly....3 versions - Latest release: 12 months ago - 25 downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/scorer 0.4.0
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your ap...18 versions - Latest release: 11 months ago - 110 downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/ai 0.10.1
SDK for calling different LLM APIs using OpenAI format15 versions - Latest release: 11 months ago - 97 downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/types 0.11.0
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your ap...17 versions - Latest release: 11 months ago - 104 downloads last month - 146 stars on GitHub - 2 maintainers
empiricalrun 0.14.0
[](https://npmjs.com/package/empiricalrun) [](https://npmjs.com/package/@empiricalrun/...26 versions - Latest release: 11 months ago - 153 downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/r2-uploader 0.3.8
Node.js library to upload files to R214 versions - Latest release: 3 months ago - 2.28 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@gptp/callback-prompt 0.7.0
Library to supercharge your use of large language models2 versions - Latest release: over 1 year ago - 12 downloads last month - 109 stars on GitHub - 1 maintainer
@gptp/types 0.7.15
Library to supercharge your use of large language models7 versions - Latest release: over 1 year ago - 38 downloads last month - 109 stars on GitHub - 1 maintainer
@gptp/core 0.7.15
Library to supercharge your use of large language models24 versions - Latest release: over 1 year ago - 125 downloads last month - 109 stars on GitHub - 1 maintainer
deepinfra 2.0.2
Official API wrapper for DeepInfra1 version - Latest release: 12 months ago - 12.7 thousand downloads last month - 10 stars on GitHub - 1 maintainer
aibitat 0.0.3
An extensible, stateless and customizable framework for multi-agents conversation6 versions - Latest release: over 1 year ago - 1 dependent package - 10 downloads last month - 121 stars on GitHub - 1 maintainer
@gptp/remote-client 0.7.15
Library to supercharge your use of large language models12 versions - Latest release: over 1 year ago - 15 downloads last month - 107 stars on GitHub - 1 maintainer
@gptp/wizzard 0.7.15
Library to supercharge your use of large language models12 versions - Latest release: over 1 year ago - 3 downloads last month - 107 stars on GitHub - 1 maintainer
@gptp/openai 0.7.15 removed
Library to supercharge your use of large language models12 versions - Latest release: over 1 year ago - 92 downloads last month - 7 stars on GitHub - 1 maintainer
Related Keywords
llm
52
ai
52
natural-language-processing
47
language-model
46
gpt-4
45
nlp
45
gpt-3
44
openai
44
machine-learning
44
autogpt
44
chatgpt
44
template
44
prompt
44
o1-preview
30
o1-mini
30
o1
30
gpt-4o-mini
30
gpt-4o
30
anthropic
30
LLMOps
30
deepseek
28
o3-mini
28
o3
28
llmops
17
pipeline
14
automation
14
text-generation
14
testing-framework
14
testing
14
test-automation
14
evaluation-framework
14
agents
6
llama
6
mistral
4
llama2
4
generative-ai
3
typescript
3
node
3
fellou
3
eko
3
agent
3
agentic-ai
3
agentic-ai-development
3
agentic-framework
3
agentic-workflow
3
ai-agents
3
browser-automation
3
browseruse
3
chain-of-thought
3
computer-automation
3
computeruse
3
workflow
3
rag
3
genai
3
prompt-engineering
3
natural-language-inference
3
llmapi
3
llm-agents
3
bentoml
2
efficient-inference
2
gemma
2
language-models
2
large-language-model
2
llama3
2
llms
2
mixtral
2
model-compression
2
local
2
quantization
2
self-hosted
2
inference
2
deep-learning
2
fine-tuning
2
falcon
2
llm-ops
2
llm-serving
2
ml
2
mlops
2
model-inference
2
mpt
2
open-source-llm
2
openllm
2
stablelm
2
vicuna
2
offline
2
compression
2
typesript
1
wrapper
1
api
1
deepinfra
1
webgpu
1
tts
1
localllm
1
nodejs
1
ai-chat
1
llamacpp
1
LLM
1
gguf
1
yolo
1
large language model
1