Python

Dynamic Prompt Compression System with Learned Importance Scores

A hands‑on guide to building a from‑scratch prompt compression system that learns token importance and truncates context for fixed‑size LLM windows.

Speculative decoding engine illustration

Hands‑On Build Guide: Speculative Decoding Engine in Pure Python

A step‑by‑step guide to creating a speculative decoding prototype in pure Python, showcasing algorithmic design, performance tuning, and production‑ready patterns.

A sleek terminal showing a Python script scheduling LLM requests

Continuous Batching LLM Scheduler: Hands‑On Build Guide

A step‑by‑step guide to building a runnable continuous batching LLM scheduler that you can showcase on your CV, with architecture, code, testing, and extension ideas.

A visualization of quantized weight tensors with block-wise scaling

Building a Pure-Python INT4 Transformer Weight Quantizer with Block-Wise Per-Channel Scaling

A practical guide to building a pure-Python INT4 quantizer for transformer weights, demonstrating real systems skills for your portfolio.

Hands-On Build Guide: Sliding-Window Attention KV Cache with LRU Eviction

A hands‑on guide to implementing a sliding‑window attention KV cache with LRU eviction, complete with runnable Python code, benchmarks, and extension ideas for production use.