From Scratch Sparse MoE Inference Engine
Build a sparse Mixture‑of‑Experts inference engine from scratch in Python, mastering top‑k gating, capacity‑constrained dispatch, and load‑balancing loss.
Python
User Safety: safe — A Hands-On Build Guide for Your Portfolio
A complete build guide for a User Safety scoring engine — covering architecture, step-by-step implementation with real code, testing strategies, and a senior-level extension roadmap.
Hands-On Build Guide: Pure‑Python GGUF Weight Loader with Lazy Memory‑Mapped Tensor Initialization
A step‑by‑step guide to creating a pure‑Python GGUF weight loader that lazily memory‑maps tensors, perfect for demonstrating low‑level Python systems skills on a CV.
Building a Real-Time User Safety Pipeline: A Portfolio Project
A hands-on guide to building a production-flavored user safety service that ingests, moderates, and logs user content in real time.
Build a Mini LLM Inference Engine with Tree-Attention Speculative Decoding
Learn to implement a compact LLM inference engine that showcases advanced systems skills, from KV cache reuse to tree-attention speculative decoding.