Building a Production-Grade Model Quantizer for Your Portfolio
A step-by-step guide to building a model quantizer that shrinks neural networks for edge deployment, demonstrating systems engineering skills to recruiters.
A step-by-step guide to building a model quantizer that shrinks neural networks for edge deployment, demonstrating systems engineering skills to recruiters.
A hands‑on guide to building a minimal GPT‑style model from scratch, with runnable code, testing, and extension ideas for a standout portfolio project.
Ship a production-flavored BPE tokenizer end to end: byte-level pretokenization, regex splitting, merge learning, and a Tkinter visualization that animates each merge so you can actually see vocabulary grow.
Build a from-scratch paged KV cache manager for LLM inference, with block-level prefix sharing and copy-on-write semantics. A real systems project for your CV.
Ship a working continuous batching scheduler with paged KV cache and dynamic request interleaving. Real Python, runnable locally, and a roadmap from toy to production-flavored.