Distributed-Systems

Apache NiFi and the Architecture of Schema-Aware Data ETL

Apache NiFi enables automated, directed data flow between systems with built-in backpressure and schema management, making it a robust choice for modern ETL architectures.

A diagram of a distributed log shipper architecture

Building LogRelay: A Distributed Log Shipper for Your Portfolio

Build LogRelay, a distributed log shipper that signals real systems engineering skills. Learn how to implement backpressure, batching, and persistence in Go.

Redis Cluster nodes connected in a circular diagram

Architecting a Redis Cluster Cache: Shard‑Aware Routing, Failover, and Hot‑Key Mitigation

A practical guide to building a resilient Redis Cluster cache, covering shard routing, failover patterns, and hot‑key mitigation techniques.

Code editor showing a Python-based LLM serving engine implementation

Build a Pure-Python Continuous Batching LLM Serving Engine from Scratch

A hands-on guide to building a pure-Python continuous batching LLM serving engine with PagedAttention KV cache and dynamic batch scheduling — a portfolio project that signals deep systems engineering skill.

Diagram of FoundationDB's distributed transaction architecture showing sequencers, commit proxies, and logs

Architecting FoundationDB's Distributed Transaction Layer: Logs, Sequencers, and Conflict Resolution

FoundationDB’s transaction layer achieves serializable isolation through a carefully orchestrated dance of logs, sequencers, and conflict resolution. This post breaks down the architecture, the role of each component, and how the system guarantees correctness under failure.