Speculative Decoding with Parallel Verification: A Hands-On Build Guide
A practical, end-to-end guide to building a speculative decoding prototype with parallel candidate verification, complete with runnable code and deployment tips.
Llm-Inference
Building a Pure-Python Token Sampler: Temperature, Top-k, Top-p, and Min-p Decoding from Scratch
A hands-on guide to implementing four major LLM token sampling strategies from scratch in pure Python. This project signals real systems engineering skill and serves as a standout portfolio piece for ML engineering roles.
Build a Memory-Compressed Attention Engine with KV Caching from Scratch
A hands-on build guide for implementing a memory-compressed attention engine with key-value caching from scratch in Python. Includes architecture diagrams, production-grade code, and a roadmap to senior-level extensions.
Build a Speculative Decoding Engine: A Portfolio Project That Signals Real Systems Skill
A hands-on guide to building a speculative decoding engine with a draft model and verifier in pure Python. This project signals deep systems expertise and is practical enough to actually complete, with real runnable code at every step.
Building a Mini LLM Inference Engine in Pure Python
A hands-on guide to building a mini LLM inference engine featuring PagedAttention and advanced KV cache management, designed to demonstrate production-grade systems architecture on your CV.