Hands‑On Build Guide: Pure‑Python Token Sampler with Temperature, Top‑k, and Nucleus Sampling
A step‑by‑step guide to building a runnable Python token sampler with temperature, top‑k, and nucleus sampling, perfect for a CV demo.
Posts
From Scratch: Sparse Mixture-of-Experts Router in PyTorch
This project implements a sparse mixture-of-experts router with learned gating and top-k expert selection, demonstrating practical deep learning systems skills.
Mastering eBPF for Kernel-Level Tracing: Techniques and Real-World Patterns
Learn how to harness eBPF programs to safely instrument the kernel, collect metrics, and build low‑overhead tracing pipelines.
Architecting NVIDIA MIG: Virtualizing GPU Resources in Containerized Environments
NVIDIA MIG lets you slice a single GPU into multiple isolated instances, each with dedicated memory and compute. This post covers the architecture, Kubernetes integration, and production patterns for deploying MIG in containerized environments.
Build a Paged‑Attention KV Cache with Block‑Level LFU Eviction in Python
Implement a production‑inspired KV cache with paged attention and LFU block eviction; source code included for portfolio demonstration.