Machine-Learning

A diagram of a RAG pipeline with BM25 and transformer

A BM25 Sparse Retriever + Tiny Transformer Generator RAG Pipeline in Pure Python

This guide walks you through implementing a BM25 sparse retriever and a tiny decoder‑only transformer generator from scratch in pure Python, producing a functional RAG pipeline you can showcase on your CV.

A visualization of a Mixture-of-Experts architecture with sparse routing paths

Build a Sparse MoE Inference Engine from Scratch in NumPy

A hands-on guide to building a sparse MoE inference engine in pure NumPy, covering top-k gating, capacity-constrained token dispatch, and differentiable load balancing — a portfolio project that signals deep systems and ML engineering skill.

A diagram of a transformer with LoRA adapters

From‑Scratch LoRA Adapter Injection and Weight Merging in Pure Python

Implement LoRA adapter injection and weight merging from scratch in pure Python, demonstrating transformer systems engineering for hiring managers.

A sleek Python script running on a laptop, illustrating a router directing traffic to expert modules.

Hands‑On Build: Mixture‑of‑Experts Top‑K Gating Router in Pure Python

A step‑by‑step guide to implementing a mixture‑of‑experts router from scratch in Python, complete with top‑k gating, auxiliary loss, and production‑ready extensions.

GPTQ quantization engine pipeline diagram

Building a GPTQ Weight Quantization Engine from Scratch: Fisher Scoring & Mixed-Precision Calibration

Learn to build a functional GPTQ quantization engine from scratch, complete with Fisher information scoring and mixed-precision calibration, and how to signal systems-level engineering skill to hiring managers.