Python

Abstract visualization of token sampling probabilities

Build a Pure Python LLM Decoder from Scratch: Temperature, Top-k, and Top-p Sampling

A hands-on guide to implementing temperature, top-k, and top-p sampling in pure Python, with runnable code that showcases systems engineering skills.

A code editor displaying a Python sampling loop with temperature and top-k parameters

Build a From-Scratch LLM Sampler: Temperature, Top-k, Top-p in Pure Python

A hands-on guide to building a pure-Python transformer model with a custom decoding loop implementing temperature, top-k, and top-p sampling — a CV-worthy project that demonstrates deep ML systems knowledge.

A diagram of a KV cache with entries being evicted

Build a KV Cache Eviction Engine for LLM Context Windows

Implement a pluggable KV cache eviction engine from scratch, demonstrating systems thinking and production-ready patterns.

A visualization of INT4 quantization layers inside a transformer model, showing weight matrices being compressed and dequantized.

Building a From-Scratch Group-Wise INT4 Quantization Layer for LLaMA Weights

A hands-on guide to implementing group-wise INT4 quantization for LLaMA-style transformers, covering per-group scale calibration, fused dequantization kernels, and benchmarks that demonstrate real ML-systems engineering skill.

A code editor displaying Python implementation of paged attention and KV-cache management

Build a Minimal LLM Inference Engine with Paged Attention and Adaptive KV-Cache Eviction in Pure Python

A hands-on guide to building a minimal LLM inference engine with paged attention and adaptive KV-cache eviction in pure Python, designed to demonstrate real systems engineering prowess on your CV.