Hands‑On Build: Mixture‑of‑Experts Top‑K Gating Router in Pure Python
A step‑by‑step guide to implementing a mixture‑of‑experts router from scratch in Python, complete with top‑k gating, auxiliary loss, and production‑ready extensions.
Python
Hands‑On Build Guide: Sliding‑Window Context Manager with Attention‑Weighted Relevance Scoring
Learn to build a token‑aware sliding‑window context manager that keeps the most relevant prompt parts within token limits.
Pure‑Python Adaptive Nucleus Sampler: A Portfolio Project
Implement an adaptive nucleus sampler in Python that adjusts temperature and top‑p from token entropy, demonstrating systems thinking for hiring managers.
Build a BPE Tokenizer from Scratch: Parallel Vocab Builder, Priority‑Heap Merge Scheduler, Subword Regularization, and Streaming Encoder with LRU Caching
A hands‑on guide to building a production‑grade BPE tokenizer that demonstrates parallel processing, algorithmic scheduling, and caching strategies for hiring managers.
Building a GPTQ Weight Quantization Engine from Scratch: Fisher Scoring & Mixed-Precision Calibration
Learn to build a functional GPTQ quantization engine from scratch, complete with Fisher information scoring and mixed-precision calibration, and how to signal systems-level engineering skill to hiring managers.