Building a Production-Grade Byte-Level BPE Tokenizer in Pure Python
A step-by-step guide to building a byte-level BPE tokenizer with regex pre-tokenization, trie encoding, and JSON serialization in pure Python.
User Safety: Safe-by-Design Patterns for Modern Applications
A practical guide to safe-by-design user-facing systems, covering authentication patterns, fault tolerance, and real-world failure modes at scale.
Hands‑On BPE Tokenizer: Pure‑Python Incremental Merge Learning with Trie Lookup
This post walks you through building a from‑scratch BPE tokenizer in pure Python, complete with online incremental merge learning and a trie for fast tokenization. You’ll end up with a runnable library you can showcase on LinkedIn or a résumé.
Building a Speculative Decoding Engine in Pure Python: A CV-Worthy Side Project
Build a from-scratch speculative decoding engine in Python that demonstrates real systems skill. Includes a draft model, speculative sampling algorithm, and rejection sampling loop with runnable code.
Building a Block‑Sparse Sliding‑Window Attention Transformer with Reversible Layers in Pure Python
This post walks through building a block‑sparse sliding‑window attention transformer with reversible layers in pure Python, providing runnable code and architectural insights.