Build a Pure‑Python BPE Tokenizer for Your Portfolio CV
A hands‑on tutorial creating a from‑scratch BPE tokenizer in pure Python, ready to showcase on a CV.
A hands‑on tutorial creating a from‑scratch BPE tokenizer in pure Python, ready to showcase on a CV.
This tutorial walks you through implementing a unigram language model tokenizer with EM training and subword regularization in pure Python. It showcases the algorithmic and systems skills that hiring managers look for.
A complete build guide for a pure-Python top-p nucleus sampler with adaptive temperature scheduling and token probability tools, ready to run and extend.
A hands-on guide to building a deterministic sampling engine in pure Python, covering temperature, top-k, top-p, and nucleus sampling with production-grade architecture patterns you can showcase to hiring managers.
A hands-on guide to implementing four major LLM token sampling strategies from scratch in pure Python. This project signals real systems engineering skill and serves as a standout portfolio piece for ML engineering roles.