Lora | martinuke0's Blog

A visual representation of low-rank adaptation matrices decomposing a large weight matrix into two smaller ones.

Build a LoRA Rank Adaptation System From Scratch

A hands-on build guide for a LoRA rank adaptation system from scratch in PyTorch, with production-grade architecture, runnable code, and a roadmap to senior-level extensions.

LoRA fine-tuning engine architecture diagram showing adapter layers, fused updates, and runtime swapping

Build a LoRA Fine-Tuning & Inference Engine in Pure PyTorch

A hands-on build guide for a LoRA fine-tuning and inference engine featuring low-rank adapter gradients, fused weight updates, and runtime adapter swapping in pure PyTorch.

A diagram of a transformer with LoRA adapters

Building a Pure-Python LoRA Adapter for BERT: A Portfolio Project

This post walks through building a LoRA adapter injection layer for BERT in pure Python, including a complete fine-tuning loop, and shows how to extend it for production-grade systems.

Short description of the cover image subject.

Hands‑On Build Guide: LoRA‑Based LLM Fine‑Tuning for Your Portfolio CV

A hands‑on guide to building a LoRA‑based LLM fine‑tuning system you can ship to GitHub and discuss in interviews.

Neural network weights and code editor representing QLoRA fine‑tuning.

Hands-On Build Guide: QLoRA Fine‑Tuner From Scratch in PyTorch with NF4 Quantization and LoRA Merging

A step‑by‑step guide to training a quantized LLaMA‑style model with QLoRA, merging LoRA adapters, and packaging the result as a portable CV asset.