Build a Speculative Decoder From Scratch: A Portfolio Project That Signals Real Systems Skill
A working engineer’s guide to implementing a speculative decoder from scratch: draft with n-gram proposals, verify with a target model, ship it as a portfolio piece. Real code, real benchmarks, real extensions.