Hands‑On Build Guide: Speculative Decoding Inference Engine in Pure Python
A step‑by‑step guide to building a speculative decoding inference engine in pure Python, showcasing draft and target transformer architectures for portfolio impact.
A step‑by‑step guide to building a speculative decoding inference engine in pure Python, showcasing draft and target transformer architectures for portfolio impact.
A hands‑on project that implements LLM token‑sampling algorithms (temperature, top‑k, top‑p) with a CLI, tests and extensible architecture, perfect for demonstrating systems skills to hiring managers.
A step‑by‑step guide to building a GPTQ‑based quantization showcase that demonstrates low‑level systems expertise and impresses hiring managers.
A minimal, pure‑Python implementation of temperature‑scaled, top‑k, top‑p and min‑p token sampling, ready to run, test, and extend for your portfolio.
A Go‑based CLI that validates and sanitises arbitrary user input against JSON schemas, logs every decision, and ships as a static binary for instant portfolio deployment.