Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

nuget.org "efficient-inference" keyword

View the packages on the nuget.org package registry that are tagged with the "efficient-inference" keyword.

picollm 1.3.1
picoLLM Inference Engine is a highly accurate and cross-platform SDK optimized for running compre...
4 versions - Latest release: 3 months ago - 845 downloads total - 259 stars on GitHub - 1 maintainer
Related Keywords
ai 1 offline 1 private 1 llm 1 compression 1 gemma 1 generative-ai 1 language-model 1 language-models 1 large-language-model 1 llama 1 llama2 1 llama3 1 llm-inference 1 llms 1 mistral 1 mixtral 1 model-compression 1 natural-language-processing 1 quantization 1 self-hosted 1