Quantization

Building a Pure-Python GGUF Weight Loader with Dequantization for Llama Models

A hands-on guide to building a pure-Python GGUF weight loader with full dequantization support for Llama models — covering binary parsing, quantized tensor reconstruction, and a roadmap to production-grade infrastructure.

Code editor showing Python vector quantization implementation

Build a Pure Python IVF Index with Product Quantization and Residual Vector Quantization

A hands-on guide to building a pure Python IVF index with product quantization and residual vector quantization — a portfolio project that signals deep systems and ML infrastructure skill to hiring managers.

GPTQ quantization engine pipeline diagram

Building a GPTQ Weight Quantization Engine from Scratch: Fisher Scoring & Mixed-Precision Calibration

Learn to build a functional GPTQ quantization engine from scratch, complete with Fisher information scoring and mixed-precision calibration, and how to signal systems-level engineering skill to hiring managers.

A visualization of neural network weights transitioning from 32-bit float to 8-bit integer representations.

Building a Production-Grade Model Quantizer: A CV Side Project

A hands-on guide to building a neural network model quantizer from scratch. This project bridges machine learning and systems engineering, signaling real production skills to hiring managers.

A visual representation of a neural network weight matrix being compressed into INT4 format.

From Scratch: Building a GPTQ INT4 Quantizer in Pure Python

Learn how to build a GPTQ INT4 quantizer from scratch in pure Python, demonstrating deep systems and ML engineering skills that stand out to hiring managers.