Inside QUIC's Loss Recovery and Congestion Control Machinery in Production Deployures
A deep dive into the loss detection, ACK handling, and congestion control loops inside QUIC, with a focus on how they behave under real production traffic on HTTP/3 and gRPC.
Optimizing vLLM's PagedAttention Allocator for High-Throughput Batched Inference
A working engineer’s guide to the internals of vLLM’s PagedAttention memory allocator, with concrete knobs, profile traces, and production patterns for squeezing more tokens per second out of a single GPU.
Inside DuckDB's Vectorized Execution Engine: How Columnar Storage Meets SIMD-Aware Query Processing
How DuckDB combines a columnar in-memory layout with vectorized, SIMD-aware operators to deliver analytical query performance that rivals dedicated warehouses — and why the same ideas are reshaping mainstream engines like Velox and DataFusion.
Build a Continuous Batching LLM Scheduler From Scratch
Ship a working continuous batching scheduler with paged KV cache and dynamic request interleaving. Real Python, runnable locally, and a roadmap from toy to production-flavored.
Inside the Lua VM: How the Reference Implementation Compiles and Executes Bytecode
A walk through the reference Lua VM: lexing, parsing, code generation, and the register-based interpreter loop that makes Lua famously fast for a small footprint.