Building a Pure-Python INT4 Transformer Weight Quantizer with Block-Wise Per-Channel Scaling
A practical guide to building a pure-Python INT4 quantizer for transformer weights, demonstrating real systems skills for your portfolio.
Quantization
Pure-Python INT8 Weight Quantizer for Transformer Inference: A Hands-On Build Guide
Learn to implement a production‑ready INT8 quantizer with per‑channel scaling, test it on transformer weights, and extend it for real‑world deployment.
Pure Python GGUF Weight Loader: Streaming Quantized Tensors via Memory-Mapped Files
A step‑by‑step guide to building a pure Python GGUF weight loader that streams quantized tensors using memory‑mapped files, complete with code, testing, and production‑ready extensions.
Mini Post-Training Quantizer: FP32 to INT4 with Calibration and Dithering in Pure Python
This post walks through building a lightweight post-training quantizer that maps FP32 LLM weights to INT4 using calibration and dithering, with full Python code and testing steps.
Building a GGUF Tensor Dequantizer and Lazy Loader
Learn to build a memory‑efficient GGUF weight loader that dequantizes tensors on the fly, ideal for low‑resource inference.