Systems Engineering

Python code and matrix multiplication diagrams on a dark terminal screen.

Build a FlashAttention-2 Inference Kernel from Scratch in Pure Python

Learn how to build a FlashAttention-2 inference kernel from scratch in pure Python. This guide covers tiled block-sparse causal attention and fused softmax to signal deep systems engineering skills.

LoRA fine-tuning engine architecture diagram showing adapter layers, fused updates, and runtime swapping

Build a LoRA Fine-Tuning & Inference Engine in Pure PyTorch

A hands-on build guide for a LoRA fine-tuning and inference engine featuring low-rank adapter gradients, fused weight updates, and runtime adapter swapping in pure PyTorch.

Abstract visualization of a KV cache with tokens being selectively retained and evicted by a learned importance scorer

Build a Learnable Token-Importance KV Cache for LLM Inference

A hands-on build guide for a learnable token-importance KV cache that optimizes LLM inference memory. Includes real PyTorch code, architecture diagrams, and a roadmap to production-grade extensions.

A visual representation of a neural network weight matrix being compressed into INT4 format.

From Scratch: Building a GPTQ INT4 Quantizer in Pure Python

Learn how to build a GPTQ INT4 quantizer from scratch in pure Python, demonstrating deep systems and ML engineering skills that stand out to hiring managers.

A terminal dashboard showing real-time user safety metrics and anomaly alerts

User Safety: safe — A Hands-On Build Guide for a Systems-Level Side Project

A hands-on guide to building ‘safe,’ a user safety gateway in Go that demonstrates rate limiting, anomaly detection, and observability — skills hiring managers actively look for in senior systems roles.