Systems

Abstract visualization of a hierarchical graph with nodes and edges

Building a Hierarchical Navigable Small World (HNSW) Vector Index in Pure Python

Learn to build a from‑scratch HNSW index for semantic similarity search, showcasing systems skills for hiring managers.

Abstract visualization of token sampling probabilities

Build a Pure Python LLM Decoder from Scratch: Temperature, Top-k, and Top-p Sampling

A hands-on guide to implementing temperature, top-k, and top-p sampling in pure Python, with runnable code that showcases systems engineering skills.

A diagram of a KV cache with entries being evicted

Build a KV Cache Eviction Engine for LLM Context Windows

Implement a pluggable KV cache eviction engine from scratch, demonstrating systems thinking and production-ready patterns.

Cover image showing BPE tokenization process

Building a BPE Tokenizer from Scratch in Python

Implement a byte-level BPE tokenizer from scratch, test it, and extend it to production-grade tooling.

A diagram of a RAG pipeline with BM25 and transformer

A BM25 Sparse Retriever + Tiny Transformer Generator RAG Pipeline in Pure Python

This guide walks you through implementing a BM25 sparse retriever and a tiny decoder‑only transformer generator from scratch in pure Python, producing a functional RAG pipeline you can showcase on your CV.