Side-Project

Python code on a laptop screen with LLM concept art

A Hands-On Build Guide: Pure-Python From-Scratch LLM Decoding Engine

A step‑by‑step guide to building a pure‑Python LLM decoding engine from scratch, complete with runnable code, temperature, top‑k, top‑p, and typical sampling, perfect for a CV.

Python code editor with tokenization output

Build a Pure‑Python BPE Tokenizer for Your Portfolio CV

A hands‑on tutorial creating a from‑scratch BPE tokenizer in pure Python, ready to showcase on a CV.

Dynamic Prompt Compression System with Learned Importance Scores

A hands‑on guide to building a from‑scratch prompt compression system that learns token importance and truncates context for fixed‑size LLM windows.

Portfolio project: paged attention KV cache

Build a Paged‑Attention KV Cache with Block‑Level LFU Eviction in Python

Implement a production‑inspired KV cache with paged attention and LFU block eviction; source code included for portfolio demonstration.

Python code on a dark terminal, visualizing paged KV cache buckets

Build a Paged Attention KV Cache with H2O Eviction in Pure Python

Learn how to implement a paged attention KV cache with H2O eviction in pure Python, a concrete project that demonstrates low‑latency data structures, eviction policies, and production‑ready patterns for AI/ML infrastructure.