Building a BPE Tokenizer from Scratch in Pure Python
A hands‑on guide to implementing a byte‑pair encoding tokenizer in pure Python, covering vocabulary learning, encode/decode, and merge‑based subword segmentation.
Nlp
Build a Streaming Byte-Level BPE Tokenizer: A Portfolio Project That Signals Real Systems Skill
A hands-on build guide for a streaming byte-level BPE tokenizer with persistent merge queues, atomic byte-loss tracking, and reversible byte fallback for arbitrary Unicode.
Speculative Decoding with a Draft N‑gram Model: A Pure‑Python Inference Engine
This project demonstrates end‑to‑end inference engineering, from language modeling to low‑latency token generation, and signals strong systems skills to hiring managers.
Build an LLM Decoding Sampler from Scratch: A Portfolio Project That Signals Real Systems Skill
A hands-on guide to building a from-scratch LLM decoding sampler implementing temperature, top-k, top-p, and contrastive search in pure Python. Includes architecture, complete code, and a roadmap to senior-level extensions.
Build a Transformer Self-Attention Block from Scratch in Pure Python
A hands-on guide to implementing a transformer self-attention block from scratch in pure Python, covering rotary positional embeddings, causal masking, and grouped-query attention — with real, runnable code and a roadmap to production-grade extensions.