Python

Build a Pure-Python Continuous Batching LLM Serving Engine from Scratch

A hands-on guide to building a pure-Python continuous batching LLM serving engine with PagedAttention KV cache and dynamic batch scheduling — a portfolio project that signals deep systems engineering skill.

A conceptual illustration of speculative decoding with parallel paths.

Building a Pure-Python Speculative Decoding Engine for Your Portfolio

Build a pure‑Python speculative decoding engine that uses a draft LLM and parallel acceptance‑reject sampling to speed up text generation. This project highlights real systems engineering skills for your CV.

Short description of the cover image subject.

Hands‑On Build Guide: LoRA‑Based LLM Fine‑Tuning for Your Portfolio CV

A hands‑on guide to building a LoRA‑based LLM fine‑tuning system you can ship to GitHub and discuss in interviews.

Python code editor with cache manager diagram

Pure‑Python Paged Attention KV‑Cache Manager: LRU & Random Eviction

Build a lightweight, pure‑Python KV‑cache manager that implements LRU and random eviction strategies, complete with paging, testing, and extension pathways for senior‑level topics.

A diagram of a transformer attention block with sliding window

Build a Fused Causal Self-Attention Block with RoPE and Sliding-Window KV Cache in Pure Python

This guide walks through implementing a fused causal self-attention block with RoPE and a sliding-window KV cache in pure Python, giving you a concrete portfolio piece that highlights systems engineering expertise.