Python code editor with tokenization output

Build a Pure‑Python BPE Tokenizer for Your Portfolio CV

A hands‑on tutorial creating a from‑scratch BPE tokenizer in pure Python, ready to showcase on a CV.

October 16, 2026 · 9 min · 1722 words · martinuke0
Illustration of a tokenizer pipeline

Build a Unigram Language Model Tokenizer from Scratch in Pure Python

This tutorial walks you through implementing a unigram language model tokenizer with EM training and subword regularization in pure Python. It showcases the algorithmic and systems skills that hiring managers look for.

September 29, 2026 · 6 min · 1118 words · martinuke0
Python code visualizing token probability distributions and nucleus sampling

Pure-Python Top-P Nucleus Sampler with Adaptive Temperature Scheduling

A complete build guide for a pure-Python top-p nucleus sampler with adaptive temperature scheduling and token probability tools, ready to run and extend.

September 28, 2026 · 8 min · 1647 words · martinuke0
A Python code editor displaying sampling probability distributions and logits on a dark terminal.

Building a Production-Grade Sampling Engine in Pure Python

A hands-on guide to building a deterministic sampling engine in pure Python, covering temperature, top-k, top-p, and nucleus sampling with production-grade architecture patterns you can showcase to hiring managers.

September 28, 2026 · 11 min · 2308 words · martinuke0
A visualization of token probability distributions under different decoding strategies

Building a Pure-Python Token Sampler: Temperature, Top-k, Top-p, and Min-p Decoding from Scratch

A hands-on guide to implementing four major LLM token sampling strategies from scratch in pure Python. This project signals real systems engineering skill and serves as a standout portfolio piece for ML engineering roles.

September 27, 2026 · 13 min · 2609 words · martinuke0
Feedback