Building a GGUF Model Loader with Built-in Dequant: A Portfolio Project for Systems Engineers
A practical guide to building a GGUF model loader with dequantization, demonstrating systems skills for engineering roles.
Quantization
Hands-On Int4 Quantization Portfolio: Build a GPTQ/AWQ-Powered LLM CV Project
Learn how to quantize a language model to int4, integrate GPTQ and AWQ, and ship a runnable CV project that impresses hiring managers.
Building a GGUF Parser with Memory-Mapped Lazy Tensor Loading in Pure Python
A hands-on guide to building a pure-Python GGUF parser that lazily memory-maps tensors and decompresses quantized blocks on demand, demonstrating deep systems knowledge.
Build a GGUF Parser and mmap-Based Tensor Loader: A Portfolio Project That Signals Real Systems Skill
Build a production-grade GGUF parser and mmap-based tensor loader with quantized dequantization and safetensors conversion. This hands-on guide shows real code, architecture decisions, and a roadmap from toy to production.
Lazy GGUF/Safetensors Checkpoint Loader: A Hands-On Build Guide
A practical guide to building a lazy checkpoint loader that memory-maps GGUF and safetensors files, parses tensor metadata, and dequantizes on demand.