Pure-Python INT8 Weight Quantizer for Transformer Inference: A Hands-On Build Guide
Learn to implement a production‑ready INT8 quantizer with per‑channel scaling, test it on transformer weights, and extend it for real‑world deployment.
Hands‑On Build Guide: Pure‑Python Token Sampler with Temperature, Top‑k, and Nucleus Sampling
A step‑by‑step guide to building a runnable Python token sampler with temperature, top‑k, and nucleus sampling, perfect for a CV demo.
From Scratch: Sparse Mixture-of-Experts Router in PyTorch
This project implements a sparse mixture-of-experts router with learned gating and top-k expert selection, demonstrating practical deep learning systems skills.
Mastering eBPF for Kernel-Level Tracing: Techniques and Real-World Patterns
Learn how to harness eBPF programs to safely instrument the kernel, collect metrics, and build low‑overhead tracing pipelines.
Architecting NVIDIA MIG: Virtualizing GPU Resources in Containerized Environments
NVIDIA MIG lets you slice a single GPU into multiple isolated instances, each with dedicated memory and compute. This post covers the architecture, Kubernetes integration, and production patterns for deploying MIG in containerized environments.