This post explores how to achieve exactly‑once semantics in Apache Pulsar by combining transactions, fencing, and failure recovery techniques for reliable streaming pipelines.
A hands‑on guide to training a byte‑level BPE tokenizer from scratch, with streaming merge accumulation and byte‑exact roundtrip testing, perfect for demonstrating systems engineering skill.
A practical guide to architecting sub-second live streaming using WHIP for ingestion and WebTransport for low-latency delivery.
How Apache Pulsar decouples hot and cold data using BookKeeper, segment stores, and pluggable offloaders to retain petabytes of streaming data affordably.
A deep dive into Redpanda’s C++ core, the Raft-based controller quorum that replaces ZooKeeper, and what tradeoffs come with deleting a coordination service from your streaming stack.