Streaming KV Cache with Attention Sinks for Infinite Context in Pure Python
Learn to implement a streaming KV cache with attention sinks in Python, enabling infinite context for large language models.
Python
Hierarchical Navigable Small World Vector Index: A Hands‑On Portfolio Project
A step‑by‑step guide to building a hierarchical navigable small‑world vector index from scratch, with runnable code, benchmarking, and production‑ready extensions.
Pure-Python Top-P Nucleus Sampler with Adaptive Temperature Scheduling
A complete build guide for a pure-Python top-p nucleus sampler with adaptive temperature scheduling and token probability tools, ready to run and extend.
Building a Production-Grade Sampling Engine in Pure Python
A hands-on guide to building a deterministic sampling engine in pure Python, covering temperature, top-k, top-p, and nucleus sampling with production-grade architecture patterns you can showcase to hiring managers.
Hands‑on build of a pure‑Python BPE tokenizer with Huffman merge tree, live visualizer, and tiny LM demo—great for showcasing systems skills
A practical, pure‑Python BPE tokenizer with a Huffman‑coded merge tree, live visualizer, and character‑level LM demo that highlights systems engineering skills.