Building a Streaming Sliding-Window Attention Engine in Pure Python
A portfolio-grade systems project that demystifies LLM inference by implementing streaming sliding-window attention, prefix KV-cache reuse, and dynamic context eviction from scratch in pure Python.