https://martinuke0.github.io/tags/llama-cpp/ Recent content in Llama-Cpp on martinuke0's Blog https://martinuke0.github.io/%3Clink%20or%20path%20of%20image%20for%20opengraph,%20twitter-cards%3E https://martinuke0.github.io/%3Clink%20or%20path%20of%20image%20for%20opengraph,%20twitter-cards%3E Hugo -- 0.152.2 en Wed, 02 Sep 2026 20:00:49 +0000 https://martinuke0.github.io/posts/2026-09-02-optimizing-small-language-models-for-local-edge-inference-a-production-ready-guide/ Wed, 02 Sep 2026 20:00:49 +0000 https://martinuke0.github.io/posts/2026-09-02-optimizing-small-language-models-for-local-edge-inference-a-production-ready-guide/ A production-focused guide to running small language models on edge hardware: quantization, runtime choice, KV-cache tuning, and observability for real deployments.