Python

A visual representation of compressed KV cache attention with memory tiers

Build a Memory-Compressed Attention Engine with KV Caching from Scratch

A hands-on build guide for implementing a memory-compressed attention engine with key-value caching from scratch in Python. Includes architecture diagrams, production-grade code, and a roadmap to senior-level extensions.

A visualization of a hierarchical navigable small world graph with layered nodes and weighted edges

Build an HNSW Vector Index from Scratch in Pure Python

A hands-on build guide for a pure Python HNSW vector index — the data structure powering billion-scale vector search at Meta, Spotify, and Qdrant. Includes runnable code, architecture diagrams, and a senior-level extension roadmap.

A visualization of low-rank matrix decomposition applied to transformer weight matrices

Build a LoRA Adapter Trainer from Scratch: A Portfolio Project That Signals Real Systems Skill

A hands-on build guide for a from-scratch LoRA adapter trainer featuring gradient checkpointing and low-rank matrix fusion in pure Python, with architecture breakdown, runnable code, and a senior-level extension roadmap.

Hands‑On: Building a Zero‑Dependency Pure‑Python GGUF Model Loader with Memory‑Mapped Tensor Access

A lightweight, dependency‑free Python loader for GGUF models that uses memory‑mapped files and on‑the‑fly dtype conversion, perfect for a standout CV project.

Hands‑on keyboard next to a laptop showing code, representing a developer building a tokenizer

Hands-On Build Guide: Byte-Level BPE Tokenizer from Scratch

A step‑by‑step guide to implementing a byte‑level BPE tokenizer from scratch, complete with code, tests, and production‑grade extensions.