Cv | martinuke0's Blog

Illustration of a gating network routing tokens to experts

Build a Differentiable Top‑k Gating Network for MoE Layers from Scratch with NumPy

Learn how to implement a fully differentiable top‑k gating network in NumPy, enabling you to prototype mixture‑of‑experts layers and showcase a concrete, production‑ready side project on your CV.

A sleek notebook with code snippets and a transformer diagram.

Hands-On Build Guide: Minimal LoRA Fine‑Tuning Engine for a 2‑Layer Transformer

A practical, end‑to‑end guide to building a minimal LoRA fine‑tuning engine for a 2‑layer transformer, with runnable code and production‑ready extensions.

Python code on a laptop screen next to a diagram of memory blocks

Hands-On Build Guide: Paged Attention KV Cache Manager with Block Allocation and Prefix Caching in Python

A step‑by‑step guide to implementing a paged attention KV cache in Python, perfect for CV demonstration.

Short description of the cover image subject.

Hands‑On LoRA/PEFT Portfolio Project: From Scratch to Production‑Ready Fine‑Tuning

A practical, end‑to‑end guide to building a LoRA‑based CV project from scratch, with runnable code, testing, and production‑ready extensions.

A sleek Python code editor with neural network visualisation

Hands‑On MoE Router: Top‑k Gating and Load‑Balancing in Pure Python

A hands‑on guide to implementing a Mixture‑of‑Experts router from scratch in pure Python, with top‑k gating and load‑balancing, ready to run and extend.