Building a Pure-Python MoE Router with Noisy Top-K Gating and Load Balancing
A practical portfolio project: implement a MoE router from scratch in pure Python, featuring noisy top-k gating, load balancing loss, and expert assignment for transformer models.