Build a Sparse MoE Router from Scratch in NumPy
A hands-on guide to implementing a sparse MoE router from scratch in NumPy, covering noisy top-k gating, capacity-factor batching, and auxiliary load-balancing loss — a CV-worthy side project for ML systems engineers.