An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

npmjs.org "llm-inference" keyword

View the packages on the npmjs.org package registry that are tagged with the "llm-inference" keyword.

@eko-ai/eko 1.3.0
Empowering language to transform human words into action.
60 versions - Latest release: about 10 hours ago - 2.03 thousand downloads last month - 2,943 stars on GitHub - 3 maintainers
@promptbook/core 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
613 versions - Latest release: 8 days ago - 23.6 thousand downloads last month - 109 stars on GitHub - 1 maintainer
Top 2.8% on npmjs.org
gpt4all 4.0.0
Native Node.js LLM bindings for all.
10 versions - Latest release: about 1 year ago - 4 dependent packages - 5 dependent repositories - 718 downloads last month - 70,285 stars on GitHub - 3 maintainers
@yanfanvip/gpt4all 4.0.2 removed
Native Node.js LLM bindings for all.
2 versions - Latest release: 12 months ago - 3 downloads last month - 63,563 stars on GitHub - 1 maintainer
@promptbook/javascript 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
34 versions - Latest release: 8 days ago - 2.05 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/editable 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
111 versions - Latest release: 8 days ago - 2.15 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/documents 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
183 versions - Latest release: 8 days ago - 2.17 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/google 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
125 versions - Latest release: 8 days ago - 2.17 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/gemini 0.76.0 💰
It's time for a paradigm shift. The future of software in plain English, French or Latin
2 versions - Latest release: 5 months ago - 8 downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/deepseek 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
79 versions - Latest release: 8 days ago - 2.1 thousand downloads last month - 109 stars on GitHub - 1 maintainer
promptbook 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
430 versions - Latest release: 8 days ago - 3.17 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/utils 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
607 versions - Latest release: 8 days ago - 1 dependent repositories - 2.64 million downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/fake-llm 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
362 versions - Latest release: 8 days ago - 2.36 thousand downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/cli 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
469 versions - Latest release: 8 days ago - 2.49 thousand downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/anthropic-claude 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
401 versions - Latest release: 8 days ago - 2.41 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/azure-openai 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
401 versions - Latest release: 8 days ago - 2.45 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/browser 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
284 versions - Latest release: 8 days ago - 2.32 thousand downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/execute-javascript 0.86.31 deprecated
It's time for a paradigm shift. The future of software in plain English, French or Latin
574 versions - Latest release: about 2 months ago - 533 downloads last month - 66 stars on GitHub - 1 maintainer
@promptbook/mock 0.55.0 deprecated 💰
Library to supercharge your use of large language models
72 versions - Latest release: 10 months ago - 268 downloads last month - 43 stars on GitHub - 1 maintainer
@promptbook/langtail 0.75.6 💰
It's time for a paradigm shift. The future of software in plain English, French or Latin
305 versions - Latest release: 5 months ago - 973 downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/website-crawler 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
177 versions - Latest release: 8 days ago - 2.22 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/templates 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
108 versions - Latest release: 8 days ago - 2.08 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/legacy-documents 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
181 versions - Latest release: 8 days ago - 2.15 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/pdf 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
180 versions - Latest release: 8 days ago - 2.21 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/markitdown 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
84 versions - Latest release: 8 days ago - 2.09 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/vercel 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
124 versions - Latest release: 8 days ago - 2.16 thousand downloads last month - 109 stars on GitHub - 1 maintainer
@promptbook/types 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
604 versions - Latest release: 8 days ago - 1 dependent repositories - 4.05 thousand downloads last month - 48 stars on GitHub - 1 maintainer
ptbk 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
428 versions - Latest release: 8 days ago - 3.04 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/remote-client 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
605 versions - Latest release: 8 days ago - 2.71 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/openai 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
605 versions - Latest release: 8 days ago - 1 dependent repositories - 2.61 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/remote-server 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
604 versions - Latest release: 8 days ago - 1 dependent repositories - 2.73 thousand downloads last month - 7 stars on GitHub - 1 maintainer
@promptbook/node 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
359 versions - Latest release: 8 days ago - 2.34 thousand downloads last month - 48 stars on GitHub - 1 maintainer
@promptbook/wizzard 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
316 versions - Latest release: 8 days ago - 1 dependent repositories - 2.34 thousand downloads last month - 43 stars on GitHub - 1 maintainer
@promptbook/markdown-utils 0.89.0
It's time for a paradigm shift. The future of software in plain English, French or Latin
309 versions - Latest release: 8 days ago - 2.62 thousand downloads last month - 48 stars on GitHub - 1 maintainer
openllm_client 0.0.2
TS/JS binding for OpenLLM
1 version - Latest release: almost 2 years ago - 6 downloads last month - 8,657 stars on GitHub - 1 maintainer
openllm 0.0.2
TS/JS binding for OpenLLM
1 version - Latest release: almost 2 years ago - 6 downloads last month - 8,657 stars on GitHub - 1 maintainer
@gptp/remote-server 0.7.15
Library to supercharge your use of large language models
12 versions - Latest release: over 1 year ago - 58 downloads last month - 109 stars on GitHub - 1 maintainer
@empiricalrun/playwright-utils 0.25.25
Playwright utils for test code repos of our customers
242 versions - Latest release: 3 days ago - 5.67 thousand downloads last month - 156 stars on GitHub - 1 maintainer
@empiricalrun/test-gen 0.53.12
## Usage
337 versions - Latest release: 3 days ago - 5.83 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/llm 0.14.7
Package to connect and trace LLM calls.
79 versions - Latest release: 3 days ago - 4.77 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@picovoice/picollm-node-demo 1.3.0
Picovoice PicoLLM Node.js chat and completion demos
12 versions - Latest release: about 1 month ago - 35 downloads last month - 154 stars on GitHub - 7 maintainers
@picovoice/picollm-node 1.3.0
Picovoice picoLLM Node.js binding
11 versions - Latest release: about 1 month ago - 71 downloads last month - 154 stars on GitHub - 7 maintainers
@write-with-laika/drama-engine 1.6.3
A framework for narrative agents
26 versions - Latest release: 7 months ago - 172 downloads last month - 33 stars on GitHub - 2 maintainers
@fr141d2/eko 1.0.8
Empowering language to transform human words into action.
1 version - Latest release: 3 months ago - 43 downloads last month - 2,943 stars on GitHub - 1 maintainer
@qsobad/eko 1.0.8
Empowering language to transform human words into action.
1 version - Latest release: 3 months ago - 48 downloads last month - 2,943 stars on GitHub - 1 maintainer
openvino-node 2025.1.0
OpenVINOâ„¢ utils for using from Node.js environment
9 versions - Latest release: 13 days ago - 8.93 thousand downloads last month - 6,310 stars on GitHub - 1 maintainer
@gptp/execute-javascript 0.7.15
Library to supercharge your use of large language models
12 versions - Latest release: over 1 year ago - 67 downloads last month - 109 stars on GitHub - 1 maintainer
@gptp/utils 0.7.15
Library to supercharge your use of large language models
12 versions - Latest release: over 1 year ago - 75 downloads last month - 109 stars on GitHub - 1 maintainer
@gptp/parser 0.7.0
Library to supercharge your use of large language models
2 versions - Latest release: over 1 year ago - 15 downloads last month - 109 stars on GitHub - 1 maintainer
@duck4i/llama 0.3.0
Native Node.JS plugin to run LLAMA inference directly on your machine with no other dependencies.
14 versions - Latest release: 3 months ago - 48 downloads last month - 0 stars on GitHub - 1 maintainer
@gptp/simple-prompt 0.7.0
Library to supercharge your use of large language models
2 versions - Latest release: over 1 year ago - 16 downloads last month - 109 stars on GitHub - 1 maintainer
@gptp/mock 0.7.0
Library to supercharge your use of large language models
2 versions - Latest release: over 1 year ago - 13 downloads last month - 109 stars on GitHub - 1 maintainer
@browserai/browserai 2.0.1
A library for running AI models directly in the browser
40 versions - Latest release: 21 days ago - 533 downloads last month - 1,021 stars on GitHub - 2 maintainers
@gptp/executor 0.7.0
Library to supercharge your use of large language models
2 versions - Latest release: over 1 year ago - 10 downloads last month - 109 stars on GitHub - 1 maintainer
@empiricalrun/reporter 0.23.4
Report test results to slack and elsewhere
82 versions - Latest release: 12 days ago - 2.66 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/test-run 0.7.6
## 1. Introduction
25 versions - Latest release: 27 days ago - 2.99 thousand downloads last month - 155 stars on GitHub - 1 maintainer
create-empiricalrun 0.1.1
Setup your empiricalrun project effortlessly.
2 versions - Latest release: 11 months ago - 8 downloads last month - 146 stars on GitHub - 1 maintainer
@empiricalrun/fetch 0.3.1
This module provides a fetch instance wrapper designed to handle retries and timeouts seamlessly....
3 versions - Latest release: 12 months ago - 25 downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/scorer 0.4.0
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your ap...
18 versions - Latest release: 11 months ago - 110 downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/ai 0.10.1
SDK for calling different LLM APIs using OpenAI format
15 versions - Latest release: 11 months ago - 97 downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/types 0.11.0
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your ap...
17 versions - Latest release: 11 months ago - 104 downloads last month - 146 stars on GitHub - 2 maintainers
empiricalrun 0.14.0
[![npm](https://img.shields.io/npm/v/empiricalrun)](https://npmjs.com/package/empiricalrun) [![Di...
5 versions - Latest release: 11 months ago - 21 downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/core 0.8.2
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your ap...
20 versions - Latest release: 11 months ago - 119 downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/cli 0.12.1 deprecated
[![npm](https://img.shields.io/npm/v/@empiricalrun/cli)](https://npmjs.com/package/@empiricalrun/...
26 versions - Latest release: 11 months ago - 153 downloads last month - 146 stars on GitHub - 2 maintainers
@empiricalrun/r2-uploader 0.3.8
Node.js library to upload files to R2
14 versions - Latest release: 3 months ago - 2.28 thousand downloads last month - 146 stars on GitHub - 2 maintainers
@gptp/callback-prompt 0.7.0
Library to supercharge your use of large language models
2 versions - Latest release: over 1 year ago - 12 downloads last month - 109 stars on GitHub - 1 maintainer
@gptp/types 0.7.15
Library to supercharge your use of large language models
7 versions - Latest release: over 1 year ago - 38 downloads last month - 109 stars on GitHub - 1 maintainer
@gptp/core 0.7.15
Library to supercharge your use of large language models
24 versions - Latest release: over 1 year ago - 125 downloads last month - 109 stars on GitHub - 1 maintainer
deepinfra 2.0.2
Official API wrapper for DeepInfra
1 version - Latest release: 12 months ago - 12.7 thousand downloads last month - 10 stars on GitHub - 1 maintainer
aibitat 0.0.3
An extensible, stateless and customizable framework for multi-agents conversation
6 versions - Latest release: over 1 year ago - 1 dependent package - 10 downloads last month - 121 stars on GitHub - 1 maintainer
@gptp/remote-client 0.7.15
Library to supercharge your use of large language models
12 versions - Latest release: over 1 year ago - 15 downloads last month - 107 stars on GitHub - 1 maintainer
@gptp/wizzard 0.7.15
Library to supercharge your use of large language models
12 versions - Latest release: over 1 year ago - 3 downloads last month - 107 stars on GitHub - 1 maintainer
@gptp/openai 0.7.15 removed
Library to supercharge your use of large language models
12 versions - Latest release: over 1 year ago - 92 downloads last month - 7 stars on GitHub - 1 maintainer