Ml-Engineering

Implement activation checkpointing for GPT training from scratch, with runnable Python code and production‑grade insights.

A step‑by‑step guide to implement a tiny GPT training loop with custom autograd, perfect for a CV side project that showcases low‑level ML engineering skills.

Agentic AI systems drift in capability long before they fail outright. This post breaks down the mechanisms, the production signals, and the engineering practices that keep agents sharp.