Paged-Attention

Build a Paged‑Attention KV Cache with Block‑Level LFU Eviction in Python

Implement a production‑inspired KV cache with paged attention and LFU block eviction; source code included for portfolio demonstration.

A code editor displaying Python implementation of paged attention and KV-cache management

Build a Minimal LLM Inference Engine with Paged Attention and Adaptive KV-Cache Eviction in Pure Python

A hands-on guide to building a minimal LLM inference engine with paged attention and adaptive KV-cache eviction in pure Python, designed to demonstrate real systems engineering prowess on your CV.

A visualization of paged attention memory blocks arranged in a cache hierarchy with eviction pointers

Build a Paged Attention KV-Cache Manager with LRU Eviction in Pure Python

A hands-on build guide for a paged attention KV-cache manager with LRU eviction in pure Python — a portfolio project that demonstrates LLM inference systems knowledge and signals senior-level engineering capability.

A conceptual diagram of paged KV cache blocks being allocated and managed in memory

Build a Paged KV Cache in Pure Python: A Portfolio Project That Signals Real Systems Skill

A hands-on guide to building a pure Python paged KV cache for transformer inference. This project demonstrates virtual-memory management, systems architecture, and deep learning engineering — exactly the skills hiring managers look for.

A visualization of paged KV cache memory blocks being swapped between CPU and GPU memory

Build a Paged KV Cache with Swapping for CPU-Only LLM Inference

A hands-on guide to building a paged KV cache with swapping for CPU-only LLM inference. Includes real, runnable Python code using PyTorch and demonstrates memory management patterns that signal senior-level systems skill.