PyTorch

A visualization of paged KV cache memory blocks being swapped between CPU and GPU memory

Build a Paged KV Cache with Swapping for CPU-Only LLM Inference

A hands-on guide to building a paged KV cache with swapping for CPU-only LLM inference. Includes real, runnable Python code using PyTorch and demonstrates memory management patterns that signal senior-level systems skill.

A visual representation of low-rank adaptation matrices decomposing a large weight matrix into two smaller ones.

Build a LoRA Rank Adaptation System From Scratch

A hands-on build guide for a LoRA rank adaptation system from scratch in PyTorch, with production-grade architecture, runnable code, and a roadmap to senior-level extensions.

LoRA fine-tuning engine architecture diagram showing adapter layers, fused updates, and runtime swapping

Build a LoRA Fine-Tuning & Inference Engine in Pure PyTorch

A hands-on build guide for a LoRA fine-tuning and inference engine featuring low-rank adapter gradients, fused weight updates, and runtime adapter swapping in pure PyTorch.

A diagram of a transformer with LoRA adapters

Building a Pure-Python LoRA Adapter for BERT: A Portfolio Project

This post walks through building a LoRA adapter injection layer for BERT in pure Python, including a complete fine-tuning loop, and shows how to extend it for production-grade systems.

Abstract visualization of a KV cache with tokens being selectively retained and evicted by a learned importance scorer

Build a Learnable Token-Importance KV Cache for LLM Inference

A hands-on build guide for a learnable token-importance KV cache that optimizes LLM inference memory. Includes real PyTorch code, architecture diagrams, and a roadmap to production-grade extensions.