Build a Mini GPT From Scratch in Pure NumPy: A Hiring-Manager-Worthy Project
Build a tiny GPT end-to-end in NumPy to demonstrate ownership of the ML stack: mixed precision, AdamW, cosine LR, and gradient accumulation. Code-first, with a roadmap to production-grade upgrades.