Build a BPE Tokenizer From Scratch in Pure Python
A hands-on build guide for a Byte Pair Encoding tokenizer in pure Python — complete with architecture diagrams, runnable code, testing strategy, and a senior-level extension roadmap.
Nlp
Build a From-Scratch LLM Sampler: Temperature, Top-k, Top-p in Pure Python
A hands-on guide to building a pure-Python transformer model with a custom decoding loop implementing temperature, top-k, and top-p sampling — a CV-worthy project that demonstrates deep ML systems knowledge.
Building a BPE Tokenizer from Scratch in Python
Implement a byte-level BPE tokenizer from scratch, test it, and extend it to production-grade tooling.
Build a Sliding-Window Prompt Compressor from Scratch in Pure Python
A hands-on guide to building a sliding-window prompt compressor from scratch in pure Python, using a learned importance scorer to evict low-relevance tokens and keep attention focused within a fixed context budget.
Byte-Level BPE Tokenizer: A Hands-On Build Guide for Your CV
A practical, step-by-step guide to building a byte-level BPE tokenizer with regex pre-tokenization, signaling real NLP systems engineering skill to hiring managers.