Build a Minimal Mixture-of-Experts Inference Engine in Pure Python
Implement a minimal mixture-of-experts inference engine from scratch in Python, demonstrating systems thinking, custom loss functions, and production-ready patterns.
Implement a minimal mixture-of-experts inference engine from scratch in Python, demonstrating systems thinking, custom loss functions, and production-ready patterns.
A hands-on build guide for a distributed task queue side project that demonstrates concurrency, persistence, and distributed systems skills — with real, runnable code and a clear roadmap to production-grade complexity.
A hands-on guide to building ‘safe’, a real-time user safety engine that classifies content, applies configurable rules, and flags violations — demonstrating systems architecture, ML integration, and production-grade engineering.
This guide walks through implementing a sliding-window attention KV cache with dynamic token pruning, providing runnable Python code and tests.
Learn how to build a FlashAttention-2 inference kernel from scratch in pure Python. This guide covers tiled block-sparse causal attention and fused softmax to signal deep systems engineering skills.