Transformer

Building a Block‑Sparse Sliding‑Window Attention Transformer with Reversible Layers in Pure Python

This post walks through building a block‑sparse sliding‑window attention transformer with reversible layers in pure Python, providing runnable code and architectural insights.

Hands‑On Build Guide: Pure‑Python GGUF Weight Loader & Minimal Transformer Inference Engine

A step‑by‑step guide to loading GGUF weights from safetensors and running a minimal transformer in pure Python, ready to showcase on your CV.

A visualization of quantized weight tensors with block-wise scaling

Building a Pure-Python INT4 Transformer Weight Quantizer with Block-Wise Per-Channel Scaling

A practical guide to building a pure-Python INT4 quantizer for transformer weights, demonstrating real systems skills for your portfolio.

A developer typing code with a neural network diagram in the background.

Build a LoRA Adapter from Scratch in PyTorch

Learn to code a LoRA adapter from scratch in PyTorch, enabling efficient transformer fine‑tuning and a standout CV project for engineering roles.

Build an Attention Block from Scratch: A Portfolio Project for Systems Engineers

Learn to implement a transformer attention block from scratch in Python, package it as a service, and extend it with production-grade features.