Python

Layered diagram of a quantization pipeline showing calibration, packing, and fused dequantize-matmul.

Build a GPTQ int4 Quantization Engine in Python/NumPy

Ship a runnable int4 weight-only quantization engine from scratch: GPTQ-style calibration, group-wise affine scales, and a fused dequantize-matmul kernel. Built to demonstrate real ML systems skill on a portfolio.

Abstract visualization of sliding attention windows over a token timeline

Building a Sliding-Window Attention Manager from Scratch

A from-scratch, runnable Python project that mimics the memory management at the heart of modern LLMs: sliding-window attention with dynamic eviction and a prefix-cache KV store. Includes architecture, code, tests, and a roadmap to senior-level.

Diagram of a mini GPT training pipeline showing token embeddings, attention, MLP blocks, and an optimizer loop.

Build a Mini GPT From Scratch in Pure NumPy: A Hiring-Manager-Worthy Project

Build a tiny GPT end-to-end in NumPy to demonstrate ownership of the ML stack: mixed precision, AdamW, cosine LR, and gradient accumulation. Code-first, with a roadmap to production-grade upgrades.

Build a GGUF Parser and Safetensors Loader: A From-Scratch Mmap-Backed Weight Inspector

Build a from-scratch GGUF parser and safetensors loader that memory-maps tensor data straight into numpy, with integrity checks you can drop on a CV.

Diagram of a speculative decoder: a small draft model proposing tokens that a larger target model verifies in parallel.

Build a Speculative Decoder From Scratch: A Portfolio Project That Signals Real Systems Skill

A working engineer’s guide to implementing a speculative decoder from scratch: draft with n-gram proposals, verify with a target model, ship it as a portfolio piece. Real code, real benchmarks, real extensions.