Posts

Developer using Bazel to build a monorepo

Mastering Bazel: Scalable Reproducible Build Systems for Modern Development

Bazel transforms build pipelines into deterministic, cache‑able assets, accelerating development across polyglot codebases.

Python code on a dark terminal, visualizing paged KV cache buckets

Build a Paged Attention KV Cache with H2O Eviction in Pure Python

Learn how to implement a paged attention KV cache with H2O eviction in pure Python, a concrete project that demonstrates low‑latency data structures, eviction policies, and production‑ready patterns for AI/ML infrastructure.

A diagram of a mixture-of-experts router

Build Your Own Mixture-of-Experts Router with Top‑k Gating

This tutorial walks you through building a top‑k gated mixture-of-experts router in PyTorch, giving you a concrete portfolio piece that demonstrates model architecture, sparse routing, and system‑level scaling.

Docker container running inside a CI job

Designing Deterministic Test Environments Using Docker-in-Docker for CI Pipelines

A practical guide to configuring Docker-in-Docker for reliable, repeatable CI pipelines, with patterns, security tips, and real-world examples.

Illustration of a Python neural network pipeline

From‑Scratch Speculative Decoding Engine in Pure Python

A hands‑on guide to building a from‑scratch speculative decoding engine in pure Python, with draft‑then‑verify sampling, temperature, top‑k and nucleus (top‑p) sampling, all using only numpy. Perfect for a CV‑boosting side project.