Hands-On Build Guide: A GPT‑2 Style BPE Tokenizer From Scratch in Python
A practical, runnable Python implementation of a GPT‑2 compatible BPE tokenizer, complete with regex pre‑tokenization, merge‑rank encoding, and byte‑level fallback for lossless Unicode handling.
Building a LoRA Adapter with Fused Low-Rank Projections and Weight Merging in Pure Python
A practical guide to implementing a LoRA adapter with fused low-rank projections and weight merging in pure Python, highlighting systems skills for engineering roles.
Hands-On Build Guide: Minimal Mixture-of-Experts Routing Layer for Transformers in Pure Python
A step‑by‑step guide to implementing a minimal MoE routing layer from scratch, using only NumPy and pure Python, perfect for a portfolio CV.
Build a Pure‑Python LLM Sampler: Temperature, Top‑k, and Top‑p from Scratch
Learn to implement an LLM sampler from scratch in pure Python, controlling temperature, top‑k and top‑p, and add a standout project to your CV.
Build a FlashAttention Kernel from Scratch with Python and NumPy
Implement a minimal yet functional FlashAttention kernel from scratch, leveraging NumPy’s array ops, and learn how to extend it for production use.