Building a Mini-GPT From Scratch: A Portfolio Project That Signals Real ML Systems Skill
A working engineer’s guide to building a mini-GPT training loop from scratch in PyTorch — featuring AMP, gradient accumulation, cosine warmup, weight tying, and AdamW — designed as a CV-grade portfolio piece.