Code editor showing a Python implementation of flash attention with tiling and online softmax in NumPy.

Building Flash Attention from Scratch in Pure NumPy: A CV-Worthy Systems Project

Build flash attention from scratch in pure NumPy using tiling and the online softmax trick, then extend it toward production. A deep, runnable project that signals real systems engineering to hiring managers.

September 4, 2026 · 14 min · 2834 words · martinuke0
Tiled matrix multiplication diagram with softmax rows

Building Flash Attention from Scratch in NumPy: A CV-Worthy Side Project

A working engineer’s guide to implementing Flash Attention from the ground up using tiling and the online softmax trick — runnable NumPy, end-to-end tests, and a roadmap to senior-level extensions.

September 4, 2026 · 10 min · 2047 words · martinuke0
Abstract representation of cryptographic noise packets traveling between two peers.

Inside the Noise Protocol Framework: Building Forward-Secure Handshakes from Scratch

A working engineer’s walkthrough of the Noise Protocol Framework, covering patterns, tokens, and a from-scratch implementation of a forward-secure XX handshake in Python.

September 4, 2026 · 10 min · 2009 words · martinuke0
Diagram of a mini-GPT training loop with mixed precision, gradient accumulation, and optimizer components.

Building a Mini-GPT From Scratch: A Portfolio Project That Signals Real ML Systems Skill

A working engineer’s guide to building a mini-GPT training loop from scratch in PyTorch — featuring AMP, gradient accumulation, cosine warmup, weight tying, and AdamW — designed as a CV-grade portfolio piece.

September 4, 2026 · 15 min · 3092 words · martinuke0
Diagram of Envoy proxy running a WASM filter intercepting edge requests.

Implementing Envoy's WASM Filter API for Custom Auth at the Edge

A practical guide to shipping a production-grade Envoy WASM filter that validates JWTs and custom tokens at the edge gateway.

September 4, 2026 · 9 min · 1817 words · martinuke0
Feedback