Lazy Loading LLM Weights with Safetensors, Async Prefetch, and Checksum Verification
A practical guide to building a lazy weight loader for large LLMs using safetensors, async prefetch, and checksum verification.
Posts
Pure Python GGUF Weight Loader: Streaming Quantized Tensors via Memory-Mapped Files
A step‑by‑step guide to building a pure Python GGUF weight loader that streams quantized tensors using memory‑mapped files, complete with code, testing, and production‑ready extensions.
Building a User Safety Service for Your Portfolio
Build a production-style user safety API in Python that validates profiles, enforces policies, and scales.
Hands‑On: Building a User‑Safety Portfolio Project with Safe
A hands‑on guide to creating a user‑safety tracking system that demonstrates real‑world backend skills, from API design to observability, and ships as a reproducible Docker container.
Build a ColBERT‑Style Late‑Interaction Retriever in Pure Python
Learn how to construct a fast, vector‑less late‑interaction retriever and inverted index using only standard Python, and why it impresses hiring managers.