From-Scratch Mini GPT Training Loop with Gradient Checkpointing, Mixed Precision, and a Custom CUDA‑Style Optimizer
A hands‑on guide to training a tiny GPT model end‑to‑end with gradient checkpointing, FP16 mixed precision, and a hand‑rolled optimizer, perfect for a CV‑worthy portfolio.