Illustration of a Python neural network pipeline

From‑Scratch Speculative Decoding Engine in Pure Python

A hands‑on guide to building a from‑scratch speculative decoding engine in pure Python, with draft‑then‑verify sampling, temperature, top‑k and nucleus (top‑p) sampling, all using only numpy. Perfect for a CV‑boosting side project.

October 12, 2026 · 8 min · 1561 words · martinuke0
A developer's workspace with code and retrieval diagrams.

Build a ColBERT‑Style Late‑Interaction Retriever in Pure Python

Learn how to construct a fast, vector‑less late‑interaction retriever and inverted index using only standard Python, and why it impresses hiring managers.

October 11, 2026 · 7 min · 1316 words · martinuke0
A clean visualization of probability distributions after different decoding strategies

From Scratch Decoding: Building a Pure-Python Sampler for Transformer Logits

A hands-on guide to building a pure-Python sampler for transformer logits, covering temperature scaling, top-k, top-p, and typical-p decoding from scratch.

October 11, 2026 · 9 min · 1860 words · martinuke0
A diagram of attention mechanism

Build an Attention Block from Scratch: A Portfolio Project for Systems Engineers

Learn to implement a transformer attention block from scratch in Python, package it as a service, and extend it with production-grade features.

October 10, 2026 · 8 min · 1643 words · martinuke0
A diagram of the embedding adapter architecture.

Building a Self-Supervised Embedding Adapter for Arbitrary Vectors

Learn to build a self-supervised adapter that maps any embedding to a similarity-preserving space, with production-ready PyTorch code.

October 10, 2026 · 6 min · 1087 words · martinuke0
Feedback