Python

Diagram of a speculative decoding loop with an n-gram draft model feeding into a target verification step.

Building a Speculative Decoding Engine From Scratch: A Portfolio Project That Actually Signals Systems Skill

Build a runnable speculative decoding engine in Python with an n-gram draft model and target-model verification loop — a portfolio project that demonstrates LLM inference, KV-cache reasoning, and acceptance sampling.

Animated visualization of BPE merges building a vocabulary table.

Build a Byte-Level BPE Tokenizer From Scratch: A Portfolio Project That Actually Signals Systems Skill

Ship a production-flavored BPE tokenizer end to end: byte-level pretokenization, regex splitting, merge learning, and a Tkinter visualization that animates each merge so you can actually see vocabulary grow.

Diagram of paged-attention KV cache blocks mapped across sequences

Build a Paged-Attention KV Cache Manager: A Hands-On Project That Actually Impresses Hiring Managers

Ship a runnable paged-attention KV cache manager that demonstrates real LLM systems skill: block tables, prefix-sharing across requests, and eviction policies that actually move the needle on memory.

Block diagram of paged KV cache with prefix sharing

Building a Paged KV Cache Manager with Prefix Sharing and Copy-on-Write

Build a from-scratch paged KV cache manager for LLM inference, with block-level prefix sharing and copy-on-write semantics. A real systems project for your CV.

Diagram of a streaming attention engine processing tokens through a sliding window with KV-cache reuse.

Building a Streaming Sliding-Window Attention Engine in Pure Python

A portfolio-grade systems project that demystifies LLM inference by implementing streaming sliding-window attention, prefix KV-cache reuse, and dynamic context eviction from scratch in pure Python.