Ml | martinuke0's Blog

Hands‑On: Building a Zero‑Dependency Pure‑Python GGUF Model Loader with Memory‑Mapped Tensor Access

A lightweight, dependency‑free Python loader for GGUF models that uses memory‑mapped files and on‑the‑fly dtype conversion, perfect for a standout CV project.

NumPy code on a laptop screen illustrating attention matrices

Hands‑On Build Guide: Page‑Transformer Inference with Greedy KV‑Cache Eviction and Paged Attention in Numpy

A step‑by‑step guide to implementing a lightweight page‑transformer with paged attention and KV‑cache eviction, ready to run and extend.

A schematic of a mixture-of-experts model routing tokens to experts.

Build a Minimal Mixture-of-Experts Inference Engine in Pure Python

Implement a minimal mixture-of-experts inference engine from scratch in Python, demonstrating systems thinking, custom loss functions, and production-ready patterns.