Hands-On Build Guide: QLoRA Fine‑Tuner From Scratch in PyTorch with NF4 Quantization and LoRA Merging
A step‑by‑step guide to training a quantized LLaMA‑style model with QLoRA, merging LoRA adapters, and packaging the result as a portable CV asset.
A step‑by‑step guide to training a quantized LLaMA‑style model with QLoRA, merging LoRA adapters, and packaging the result as a portable CV asset.
A hands‑on guide to building a LoRA adapter layer in pure PyTorch, with complete code, merge/unmerge, and tips for turning the project into a CV‑standing side project.
A hands-on guide to building a multi-head self-attention block with RoPE and ALiBi from scratch, signaling advanced ML and systems engineering skills to hiring managers.
Implement a Switch Transformer‑style sparse mixture‑of‑experts layer in PyTorch, complete with differentiable routing, capacity limits, and load‑balancing loss.
A hands-on build guide for implementing a LoRA adapter from scratch in PyTorch, including rank-decomposed weight matrices and a complete fine-tuning loop for BERT — designed to signal real ML engineering skill on a portfolio.