From-Scratch

A working engineer’s end-to-end guide to assembling a transformer language model in PyTorch: from BPE tokenization to multi-head attention, rotary embeddings, and a real training loop on a single GPU.