Hands‑On Build Guide: LoRA‑Augmented Transformer Attention Block in Pure Python
A step‑by‑step guide to implementing a LoRA‑modulated attention block in pure Python, complete with runnable code, testing, and a roadmap to production‑grade extensions.
A step‑by‑step guide to implementing a LoRA‑modulated attention block in pure Python, complete with runnable code, testing, and a roadmap to production‑grade extensions.
A practical, end-to-end guide to building a speculative decoding prototype with parallel candidate verification, complete with runnable code and deployment tips.
Build a compact LoRA engine from scratch, demonstrating systems skills that catch hiring managers’ eyes.
Build a from‑scratch paged attention engine in pure Python, complete with LRU‑based KV‑cache eviction and GPU‑free sliding‑window simulation. Great for demonstrating systems‑level ML engineering skill.
A step‑by‑step guide to building a pure‑Python LLM decoding engine from scratch, complete with runnable code, temperature, top‑k, top‑p, and typical sampling, perfect for a CV.