Mini Post-Training Quantizer: FP32 to INT4 with Calibration and Dithering in Pure Python
This post walks through building a lightweight post-training quantizer that maps FP32 LLM weights to INT4 using calibration and dithering, with full Python code and testing steps.