Hands-On Build Guide: Sliding-Window Attention KV Cache with LRU Eviction
A hands‑on guide to implementing a sliding‑window attention KV cache with LRU eviction, complete with runnable Python code, benchmarks, and extension ideas for production use.
Cv
Pure-Python INT8 Weight Quantizer for Transformer Inference: A Hands-On Build Guide
Learn to implement a production‑ready INT8 quantizer with per‑channel scaling, test it on transformer weights, and extend it for real‑world deployment.
Pure Python Paged Attention Engine with LRU KV‑Cache Eviction
A step‑by‑step guide to building a pure Python paged attention engine with LRU cache eviction, perfect for demonstrating systems‑level skills to ML recruiters.
Build a Paged Attention KV Cache with H2O Eviction in Pure Python
Learn how to implement a paged attention KV cache with H2O eviction in pure Python, a concrete project that demonstrates low‑latency data structures, eviction policies, and production‑ready patterns for AI/ML infrastructure.
Build Your Own Fused Low‑Rank LoRA Fine‑Tuning Engine From Scratch
A hands‑on guide to building a fused low‑rank LoRA fine‑tuning engine from scratch, with runnable PyTorch code, architecture diagrams, and production‑ready extensions.