Build a Blockwise INT4 Inference Engine: A Hands-On Portfolio Project
A hands-on build guide for a blockwise INT4 inference engine with packed-nibble weights, per-group scales/zero-points, and fused dequantizing GEMM — a portfolio project that demonstrates real systems and ML engineering depth.