Transformer-Inference

A conceptual diagram of paged KV cache blocks being allocated and managed in memory

Build a Paged KV Cache in Pure Python: A Portfolio Project That Signals Real Systems Skill

A hands-on guide to building a pure Python paged KV cache for transformer inference. This project demonstrates virtual-memory management, systems architecture, and deep learning engineering — exactly the skills hiring managers look for.

Stylized diagram of a GPU die with attention tile matrices overlaid in cyan and amber.

Optimizing Triton Kernels for Custom Attention Patterns on H100 GPUs

A working engineer’s guide to squeezing the H100 with custom Triton kernels: tile sizing, swizzle patterns, pipeline stages, and the warp-specialization tricks that make non-vanilla attention fly.

Feedback