Build a vLLM-Style PagedAttention Inference Engine in Pure Python
Learn to implement a lightweight paged attention inference engine in Python, showcasing real systems skills for hiring managers.
Hands‑On Speculative Decoding Engine in Pure Python
A hands‑on guide to building a speculative decoding engine in pure Python, demonstrating system‑level engineering skills and producing runnable code for your portfolio.
Pure‑Python GGUF Weight Loader and Tensor Decoder: A Hands‑On CV Side Project
A step‑by‑step guide to creating a pure‑Python GGUF weight loader and tensor decoder, complete with runnable code, quantized type support, and multi‑tensor metadata – perfect for a CV‑boosting side project.
Dynamic Temperature Scheduler for LLM Sampling
A hands‑on guide to a token‑level temperature scheduler that reacts to entropy and applies top‑k/top‑p filtering, perfect for showcasing systems expertise.
Build a Medusa Speculative Decoding Engine in Pure Python
Learn how to construct a Medusa‑style speculative decoding engine in pure Python, from architecture to testing, and how the project signals production‑grade systems skills to hiring managers.