Building an Agent from Scratch: A Production-Oriented Walkthrough
A working engineer’s guide to building an LLM agent from zero: the planning loop, tool integration, memory, guardrails, and the production patterns that turn a demo into a service.
A working engineer’s guide to building an LLM agent from zero: the planning loop, tool integration, memory, guardrails, and the production patterns that turn a demo into a service.
Ship a working continuous batching scheduler with paged KV cache and dynamic request interleaving. Real Python, runnable locally, and a roadmap from toy to production-flavored.
Build a streaming token sampler from scratch in PyTorch covering temperature, top-k, top-p, min-p, and contrastive search — a CV-worthy systems project for ML engineers.
Build a working LoRA fine-tuning loop in pure NumPy, computing every gradient by hand through low-rank adapters. A practical side project that demonstrates real systems understanding to hiring managers.
Build a production-shaped WordPiece tokenizer in Python with subword merging, BERT special tokens, and a greedy decode path. Includes runnable code, tests, and a roadmap to senior-level extensions.