A hands-on guide to building a distributed task queue in Go with Raft consensus, write-ahead log persistence, worker pools, and a live dashboard — the kind of project that signals real distributed systems skill on a CV.
A hands-on guide to building a minimal LLM inference engine with paged attention and adaptive KV-cache eviction in pure Python, designed to demonstrate real systems engineering prowess on your CV.
A hands-on guide to building a custom gradient checkpointing engine in PyTorch. This side project demonstrates deep memory management and autograd mastery, making your CV stand out to AI infrastructure roles.
Learn how to build a high-performance speculative decoding engine from scratch, mastering KV-cache management and token-tree verification to optimize LLM inference.
A hands-on guide to building a sliding-window prompt compressor from scratch in pure Python, using a learned importance scorer to evict low-relevance tokens and keep attention focused within a fixed context budget.