https://martinuke0.github.io/tags/optimizers/ Recent content in Optimizers on martinuke0's Blog https://martinuke0.github.io/%3Clink%20or%20path%20of%20image%20for%20opengraph,%20twitter-cards%3E https://martinuke0.github.io/%3Clink%20or%20path%20of%20image%20for%20opengraph,%20twitter-cards%3E Hugo -- 0.152.2 en Sun, 06 Sep 2026 06:01:04 +0000 https://martinuke0.github.io/posts/2026-09-06-building-mixed-precision-adamw-with-zero-1-from-scratch-in-pure-pytorch/ Sun, 06 Sep 2026 06:01:04 +0000 https://martinuke0.github.io/posts/2026-09-06-building-mixed-precision-adamw-with-zero-1-from-scratch-in-pure-pytorch/ A hands-on build guide for implementing mixed-precision AdamW with dynamic loss scaling and ZeRO-1 sharded optimizer state in pure PyTorch — a portfolio project that signals real systems skill.