From‑Scratch MoE Transformer Block with Sinkhorn Routing in NumPy
A hands‑on guide to building a Mixture‑of‑Experts transformer block from scratch in NumPy. It features Sinkhorn‑based routing and balanced expert load, ready to showcase on a CV.
A Hands-On Build Guide: Mixture-of-Experts Router with Top-K Gating and Auxiliary Load-Balancing Loss
A complete guide to building a Mixture-of-Experts router from scratch, including top-k gating, auxiliary load-balancing loss, runnable Python/NumPy code, and production-ready extensions for your CV.
Build a Mini GPT Trainer: Hand‑Roll Autograd + Data‑Parallel All‑Reduce in Pure NumPy
Learn how to implement a tiny GPT trainer in pure NumPy, complete with autograd and distributed gradient all‑reduce, and why it signals real systems skill to hiring managers.
From-Scratch Paged KV-Cache with Block-Table Virtual Memory and Eviction Policies in Python
A hands‑on guide to building a paged KV‑cache in Python, complete with virtual memory, eviction policies, and benchmark results you can run today.
Implementing SPIFFE Workload Identity for Zero Trust Networks
SPIFFE replaces static credentials with dynamic mTLS for workloads. This article covers deployment patterns, service mesh integration, and hardening strategies for zero trust networks.