Build an INT4 Block-Wise Weight-Only Quantizer for Transformer Attention Layers
Build a production-grade INT4 block-wise weight-only quantizer from scratch in pure Python. This guide covers calibration, dequantization, benchmarking, and why this project signals senior ML-systems skill to hiring managers.