Pure-Python INT8 Weight Quantizer for Transformer Inference: A Hands-On Build Guide
Learn to implement a production‑ready INT8 quantizer with per‑channel scaling, test it on transformer weights, and extend it for real‑world deployment.
Python
Hands‑On Build Guide: Pure‑Python Token Sampler with Temperature, Top‑k, and Nucleus Sampling
A step‑by‑step guide to building a runnable Python token sampler with temperature, top‑k, and nucleus sampling, perfect for a CV demo.
Build a Paged‑Attention KV Cache with Block‑Level LFU Eviction in Python
Implement a production‑inspired KV cache with paged attention and LFU block eviction; source code included for portfolio demonstration.
Build a LoRA Adapter Trainer from Scratch in Pure Python
Learn to implement LoRA fine-tuning from scratch, creating a portfolio project that demonstrates real ML infrastructure expertise.
Building a Pure-Python Top-p/Top-k Sampler with Temperature Scaling for LLM Logits
This post walks through building a pure-Python top-p/top-k sampler with temperature scaling, providing runnable code and a roadmap for productionizing it.