Hands‑On MoE Router: Top‑k Gating and Load‑Balancing in Pure Python
A hands‑on guide to implementing a Mixture‑of‑Experts router from scratch in pure Python, with top‑k gating and load‑balancing, ready to run and extend.
Side-Project
From‑Scratch Mixture‑of‑Experts Routing Layer in Pure Python
A step‑by‑step tutorial creating a from‑scratch MoE routing layer in pure Python, complete with code, tests, and extension ideas for your CV.
Hands-On Int4 Quantization Portfolio: Build a GPTQ/AWQ-Powered LLM CV Project
Learn how to quantize a language model to int4, integrate GPTQ and AWQ, and ship a runnable CV project that impresses hiring managers.
Hands‑on build of a pure‑Python BPE tokenizer with Huffman merge tree, live visualizer, and tiny LM demo—great for showcasing systems skills
A practical, pure‑Python BPE tokenizer with a Huffman‑coded merge tree, live visualizer, and character‑level LM demo that highlights systems engineering skills.
Building a Pure-Python Token Sampler: Temperature, Top-k, Top-p, and Min-p Decoding from Scratch
A hands-on guide to implementing four major LLM token sampling strategies from scratch in pure Python. This project signals real systems engineering skill and serves as a standout portfolio piece for ML engineering roles.