Build a KV Cache Eviction Engine for LLM Context Windows
Implement a pluggable KV cache eviction engine from scratch, demonstrating systems thinking and production-ready patterns.
Context-Window
Memory‑Efficient Context Window Manager with Attention‑Guided Token Pruning
This project delivers a runnable Python library that compresses LLM context windows by scoring token importance with attention and dropping low‑impact tokens, demonstrating practical systems and ML engineering.