Hands‑On Build Guide: Minimal Mixture‑of‑Experts Router with Softmax Gating in Python
A step‑by‑step guide to building a minimal Mixture‑of‑Experts router in pure Python, complete with runnable code, testing, and production‑level extension ideas.
Python
Memory‑Aware KV Cache Eviction Engine for Long‑Context LLM Inference
A hands‑on guide to constructing a pure‑Python KV cache eviction engine that uses attention‑based pruning to reduce memory footprint for long‑context LLM inference.
Hands-On Build Guide: Paged Attention KV Cache Manager with Block Allocation and Prefix Caching in Python
A step‑by‑step guide to implementing a paged attention KV cache in Python, perfect for CV demonstration.
Build a Distributed Data-Parallel Bucketed Gradient Synchronizer from Scratch
Learn how to implement a bucketed gradient synchronizer that reduces communication overhead in distributed training, perfect for a portfolio project that signals real systems engineering skill.
Hands‑On LoRA/PEFT Portfolio Project: From Scratch to Production‑Ready Fine‑Tuning
A practical, end‑to‑end guide to building a LoRA‑based CV project from scratch, with runnable code, testing, and production‑ready extensions.