Dynamic Prompt‑Window Manager with Sliding‑Window Context Caching
Learn how to construct a sliding‑window context cache with importance‑based eviction, a portable project that showcases systems engineering skill for LLM‑focused roles.
Hands-On Build Guide: Pure Python BPE Tokenizer for Your Portfolio CV
A step-by-step guide to implementing a byte-pair encoding tokenizer in pure Python, complete with code, testing, and production extensions.
Build a paged attention KV cache with block‑wise LRU eviction in pure Python, demonstrating advanced systems engineering skills for machine learning engineer roles
This project implements a paged attention KV cache with block‑wise LRU eviction, providing a concrete demonstration of memory management and algorithm design for LLM inference.
Designing a Tokio Work-Stealing Scheduler: Task Queues, Reactors, and Waker Plumbing in Rust
A practical deep-dive into Tokio’s scheduler mechanics, from task queues and work-stealing to the waker patterns that make async I/O fast and fair.
Build a SIMD-Accelerated IVF-PQ Vector Index in Python
A comprehensive guide to building a production-style vector index from scratch, focusing on memory efficiency and computational speed.