Diagram of mmap-backed tensor parsing pipeline reading GGUF and safetensors files.

Build a GGUF Parser and Safetensors Loader: A From-Scratch Mmap-Backed Weight Inspector

Build a from-scratch GGUF parser and safetensors loader that memory-maps tensor data straight into numpy, with integrity checks you can drop on a CV.

September 5, 2026 · 13 min · 2734 words · martinuke0
Diagram of a GGUF file layout with tensor metadata and quantized weight blocks.

Building a GGUF Parser and Tensor Loader From Scratch: A Portfolio Project That Actually Signals Systems Skill

Build a real GGUF parser and tensor loader from scratch in Rust — metadata parsing, q4_0/q8_0 dequantization, mmap’d weight streaming, and a minimal Llama forward pass. The kind of CV project that gets interviews at systems and ML infra teams.

September 5, 2026 · 13 min · 2735 words · martinuke0
Diagram of GGUF file structure flowing into a PyTorch model.

Building a GGUF Weight Loader From Scratch: A CV-Grade ML Systems Project

Build a runnable GGUF parser and dequantizer for Q4_K and Q6_K, map the result into a PyTorch Llama model, and end up with a project that signals real ML systems skill on your CV.

September 5, 2026 · 15 min · 2983 words · martinuke0
Diagram of a GGUF file being parsed into numpy tensors with dequantization steps.

Building a GGUF Parser and Dequantizer From Scratch: A Portfolio Project That Signals Real Systems Skill

Parse GGUF, dequantize Q4_0 and Q8_0 tensors, and load Llama weights into numpy. A hands-on guide to a side project that demonstrates real systems engineering on a CV.

September 5, 2026 · 14 min · 2871 words · martinuke0
A small circuit board with a quantized model graph overlaid, representing local edge LLM inference.

Optimizing Small Language Models for Local Edge Inference: A Production-Ready Guide

How to ship small language models to local edge devices without falling into the usual latency, memory, or quality traps. Covers quantization, llama.cpp, batching, and the operational metrics that actually matter.

September 2, 2026 · 11 min · 2310 words · martinuke0
Feedback