Parse GGUF, dequantize Q4_0 and Q8_0 tensors, and load Llama weights into numpy. A hands-on guide to a side project that demonstrates real systems engineering on a CV.
A complete, runnable Python project that pairs a draft n-gram model with a target LLM to verify multiple tokens per forward pass, plus a roadmap for turning it into production-flavored work.
A deep dive into Redpanda’s C++ core, the Raft-based controller quorum that replaces ZooKeeper, and what tradeoffs come with deleting a coordination service from your streaming stack.
Build flash attention from scratch in pure NumPy using tiling and the online softmax trick, then extend it toward production. A deep, runnable project that signals real systems engineering to hiring managers.
A working engineer’s guide to implementing Flash Attention from the ground up using tiling and the online softmax trick — runnable NumPy, end-to-end tests, and a roadmap to senior-level extensions.