Deep Learning

Illustration of a neural network training loop

Mini GPT Training Loop with Custom Autograd: A Hands-On Portfolio Project

A step‑by‑step guide to implement a tiny GPT training loop with custom autograd, perfect for a CV side project that showcases low‑level ML engineering skills.

A visual representation of low-rank adaptation matrices decomposing a large weight matrix into two smaller ones.

Build a LoRA Rank Adaptation System From Scratch

A hands-on build guide for a LoRA rank adaptation system from scratch in PyTorch, with production-grade architecture, runnable code, and a roadmap to senior-level extensions.

Python code and matrix multiplication diagrams on a dark terminal screen.

Build a FlashAttention-2 Inference Kernel from Scratch in Pure Python

Learn how to build a FlashAttention-2 inference kernel from scratch in pure Python. This guide covers tiled block-sparse causal attention and fused softmax to signal deep systems engineering skills.

LoRA fine-tuning engine architecture diagram showing adapter layers, fused updates, and runtime swapping

Build a LoRA Fine-Tuning & Inference Engine in Pure PyTorch

A hands-on build guide for a LoRA fine-tuning and inference engine featuring low-rank adapter gradients, fused weight updates, and runtime adapter swapping in pure PyTorch.

A visualization of a KV cache data structure with key and value tensors being incrementally appended during autoregressive LLM decoding.

Building a Pure Python Incremental KV Cache for Efficient Long-Context LLM Inference

Build a production-grade incremental KV cache from scratch in pure Python. This guide covers architecture, implementation, testing, and a roadmap to production-flavored features that signal real systems skill to hiring managers.