ML 5 Quantization 3 LLM 3 PyTorch 2 CLI 2 Benchmark 2 LLMs 2 AI 2 Large Language Models 2 Inference 2 Tool calling 2 Local LLM 2 Local Inference 2 On-device AI 2 SLM 2 Realtime LLM 2 Sustainable AI 2 LiteRT 2 TFLite 2 Google 2 NPU 2 Gemma 2 On-Device ML 2 Inference engine 2 Edge Impulse 2 Inference library 2 Local AI 2 inference-engine 2 slm 1 stt 1 react-native 1 python-llm 1 python 1 on-device-ai 1 llm 1 swift 1 tts 1 llamacpp 1 llm-inference 1 local-ai 1 ollama 1 rust 1 kotlin 1 godot4 1 godot-plugin 1 godot-engine 1 godot 1 flutter 1 ai 1 LLM Distillation 1 LLM Quantization 1 LLM Compression 1 Lightweight LLM 1 Distillation 1 Quantization-Aware Distillation 1 Model Compression 1 Lightweight AI 1