Hands-On Build Guide: Paged Attention KV Cache Manager with Block Allocation and Prefix Caching in Python
A step‑by‑step guide to implementing a paged attention KV cache in Python, perfect for CV demonstration.
Machine-Learning
Build a Distributed Data-Parallel Bucketed Gradient Synchronizer from Scratch
Learn how to implement a bucketed gradient synchronizer that reduces communication overhead in distributed training, perfect for a portfolio project that signals real systems engineering skill.
Hands‑On MoE Router: Top‑k Gating and Load‑Balancing in Pure Python
A hands‑on guide to implementing a Mixture‑of‑Experts router from scratch in pure Python, with top‑k gating and load‑balancing, ready to run and extend.
Building a GGUF Model Loader with Built-in Dequant: A Portfolio Project for Systems Engineers
A practical guide to building a GGUF model loader with dequantization, demonstrating systems skills for engineering roles.
Build a Unigram Language Model Tokenizer from Scratch in Pure Python
This tutorial walks you through implementing a unigram language model tokenizer with EM training and subword regularization in pure Python. It showcases the algorithmic and systems skills that hiring managers look for.