Machine-Learning

A visualization of quantized weight tensors with block-wise scaling

Building a Pure-Python INT4 Transformer Weight Quantizer with Block-Wise Per-Channel Scaling

A practical guide to building a pure-Python INT4 quantizer for transformer weights, demonstrating real systems skills for your portfolio.

Hands-On Build Guide: Sliding-Window Attention KV Cache with LRU Eviction

A hands‑on guide to implementing a sliding‑window attention KV cache with LRU eviction, complete with runnable Python code, benchmarks, and extension ideas for production use.

A laptop displaying code for LoRA adapter training

Build a LoRA Adapter Trainer from Scratch in Pure Python

Learn to implement LoRA fine-tuning from scratch, creating a portfolio project that demonstrates real ML infrastructure expertise.

Building a Pure-Python Top-p/Top-k Sampler with Temperature Scaling for LLM Logits

This post walks through building a pure-Python top-p/top-k sampler with temperature scaling, providing runnable code and a roadmap for productionizing it.

A sleek Python code editor with visual cache diagrams

Pure Python Paged Attention Engine with LRU KV‑Cache Eviction

A step‑by‑step guide to building a pure Python paged attention engine with LRU cache eviction, perfect for demonstrating systems‑level skills to ML recruiters.