Hands‑On MoE Router: Top‑k Gating and Load‑Balancing in Pure Python
A hands‑on guide to implementing a Mixture‑of‑Experts router from scratch in pure Python, with top‑k gating and load‑balancing, ready to run and extend.
Moe
Build a Sparse MoE Inference Engine from Scratch in NumPy
A hands-on guide to building a sparse MoE inference engine in pure NumPy, covering top-k gating, capacity-constrained token dispatch, and differentiable load balancing — a portfolio project that signals deep systems and ML engineering skill.
Build a Sparse MoE Router from Scratch in NumPy
A hands-on guide to implementing a sparse MoE router from scratch in NumPy, covering noisy top-k gating, capacity-factor batching, and auxiliary load-balancing loss — a CV-worthy side project for ML systems engineers.