Systems-Design

A diagram of a paged KV-cache with pages and eviction policies.

Building a Paged KV-Cache Simulator in Pure Python: A Portfolio Project for Systems Engineers

A practical guide to implementing a paged KV-cache simulator with pluggable eviction policies, perfect for showcasing systems design abilities to hiring managers.

A diagram of a mixture-of-experts router with multiple expert networks and a gating mechanism

Build a Mixture-of-Experts Router from Scratch: A Portfolio Project That Signals Real Systems Skill

A hands-on guide to building a mixture-of-experts router from scratch in Python, covering top-k gating, capacity factor scheduling, and load balancing loss — a CV-worthy project that signals real systems and ML engineering skill.

User Safety: Safe — A Portfolio Project That Signals Systems Skill

Build a user safety microservice in Go that validates content, enforces rate limits, and scales horizontally — a portfolio project proving you can ship real systems.

A token‑aware sliding window for LLM prompt truncation

Hands‑On Build Guide: Sliding‑Window Context Manager with Attention‑Weighted Relevance Scoring

Learn to build a token‑aware sliding‑window context manager that keeps the most relevant prompt parts within token limits.

A conceptual diagram of a user safety pipeline with input validation, classification, rule engine, and alerting stages.

User Safety: safe — A Hands-On Build Guide for a Portfolio-Worthy Systems Project

A hands-on guide to building ‘safe’, a real-time user safety engine that classifies content, applies configurable rules, and flags violations — demonstrating systems architecture, ML integration, and production-grade engineering.