Hands‑On Build Guide: Page‑Transformer Inference with Greedy KV‑Cache Eviction and Paged Attention in Numpy
A step‑by‑step guide to implementing a lightweight page‑transformer with paged attention and KV‑cache eviction, ready to run and extend.
Ml
Build a Minimal Mixture-of-Experts Inference Engine in Pure Python
Implement a minimal mixture-of-experts inference engine from scratch in Python, demonstrating systems thinking, custom loss functions, and production-ready patterns.