FlashAttention Kernel from Scratch in Pure Python with Tiling and Online Softmax
This tutorial walks you through implementing a FlashAttention kernel from scratch, using tiling and online softmax to achieve memory-efficient attention. You’ll gain hands-on experience with low-level systems techniques that hiring managers value.
Hands-on LoRA Trainer from Scratch in Pure Python
A hands‑on guide to training LoRA adapters with pure Python, no heavy frameworks, ready for CV portfolio projects.
Architecting Hermetic Bazel Remote Caching for Reproducible CI Builds at Scale
Bazel’s remote caching can turn your CI from a slow, flaky bottleneck into a fast, deterministic feedback loop, but only if you architect it with hermeticity and scale in mind.
Byte‑Level BPE Tokenizer from Scratch in Pure Python
A hands‑on guide to implementing a GPT‑2‑style tokenizer from scratch, complete with runnable Python code and round‑trip byte decoding.
Pure‑Python GGUF & Safetensors Weight Loader
A hands‑on guide to writing a pure‑Python GGUF/Safetensors weight loader that reads binary headers and returns NumPy arrays, perfect for demonstrating low‑level ML engineering skill on a CV.