Caching

A laptop screen showing Python code for an attention engine

From‑Scratch Paged Attention Engine: LRU KV‑Cache Eviction and GPU‑Free Sliding‑Window Simulation in Python

Build a from‑scratch paged attention engine in pure Python, complete with LRU‑based KV‑cache eviction and GPU‑free sliding‑window simulation. Great for demonstrating systems‑level ML engineering skill.

A sleek Python code editor with visual cache diagrams

Pure Python Paged Attention Engine with LRU KV‑Cache Eviction

A step‑by‑step guide to building a pure Python paged attention engine with LRU cache eviction, perfect for demonstrating systems‑level skills to ML recruiters.

Memory‑Aware KV Cache Eviction Engine for Long‑Context LLM Inference

A hands‑on guide to constructing a pure‑Python KV cache eviction engine that uses attention‑based pruning to reduce memory footprint for long‑context LLM inference.

Dragonfly cache engine architecture diagram

Inside Dragonfly: Building a Multi-Threaded Redis-Compatible Cache Engine

Dragonfly reimagines Redis as a multi-threaded cache engine, combining full protocol compatibility with scalable performance for high-throughput applications.

RocksDB LSM-Trie architecture diagram showing tiered storage layers

Implementing LSM-Trie Caching in RocksDB: A Deep Dive into Write-Optimized Key-Value Performance

An in-depth look at implementing LSM-Trie caching in RocksDB, covering memtable hierarchies, tiered compaction strategies, and production-proven techniques for maximizing write throughput.