Python

A diagram of a transformer with paged attention and LRU cache.

Building a Pure-Python Paged-Attention Transformer with LRU KV-Cache Eviction

Implement a paged-attention transformer with LRU KV-cache eviction in pure Python, demonstrating systems engineering proficiency.

A visualization of speculative decoding: a fast draft model generates candidate tokens, which a larger verification model accepts or rejects in parallel.

Build a Speculative Decoding Inference Engine: A Hands-On CV Project

A hands-on build guide for a speculative decoding inference engine that uses a cheap n-gram draft model paired with a verification transformer. Includes real runnable code, architecture diagrams, and a roadmap for extending it into a production-grade system.

A visual representation of a neural network weight matrix being compressed into INT4 format.

From Scratch: Building a GPTQ INT4 Quantizer in Pure Python

Learn how to build a GPTQ INT4 quantizer from scratch in pure Python, demonstrating deep systems and ML engineering skills that stand out to hiring managers.

A visualization of a KV cache data structure with key and value tensors being incrementally appended during autoregressive LLM decoding.

Building a Pure Python Incremental KV Cache for Efficient Long-Context LLM Inference

Build a production-grade incremental KV cache from scratch in pure Python. This guide covers architecture, implementation, testing, and a roadmap to production-flavored features that signal real systems skill to hiring managers.

A code editor showing a Python sampler class with visualization of probability distributions

Build an LLM Decoding Sampler from Scratch: A Portfolio Project That Signals Real Systems Skill

A hands-on guide to building a from-scratch LLM decoding sampler implementing temperature, top-k, top-p, and contrastive search in pure Python. Includes architecture, complete code, and a roadmap to senior-level extensions.