Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

llm-threader

Intelligent thread pooling and scaling for local LLM requests based on CPU and GPU usage

Ecosystem
npmjs.org
Latest Release
1.1.0
3 months ago
Versions
2
Downloads
21 last month
    Loading...
    Readme
    Loading...
    Links
    Registry npmjs.org
    Source Repository
    Homepage Homepage
    JSON API View JSON
    CodeMeta codemeta.json
    Package Details
    PURL pkg:npm/llm-threader
    spec
    License MIT
    First Release 3 months ago
    Last Synced 14 days ago
    Keywords
    llm threading scaling cpu gpu local-llm resource-management thread-pool concurrency performance