Scheduler

Diagram of Tokio's work-stealing deque across worker threads

Mastering Tokio's Internal Work-Stealing Scheduler: A Deep Dive into Async Runtime Fairness

Tokio’s scheduler uses a work-stealing deque model to distribute tasks across threads. This post breaks down the internal mechanics, fairness guarantees, and practical implications for high-concurrency Rust services.

Abstract illustration of concurrent threads and data flow

Implementing Work-Stealing Runtimes: Building a Lock-Free Scheduler from Scratch

A deep dive into lock-free work-stealing schedulers, covering the theory, architecture, and a minimal implementation in Rust.

A sleek terminal showing a Python script scheduling LLM requests

Continuous Batching LLM Scheduler: Hands‑On Build Guide

A step‑by‑step guide to building a runnable continuous batching LLM scheduler that you can showcase on your CV, with architecture, code, testing, and extension ideas.

Rust code on a terminal displaying actor system diagnostics

Architecting a Lock-Free Scheduler for High-Throughput Actor Systems in Rust

Exploring lock-free scheduler design patterns for high-throughput actor systems in Rust, with real-world pitfalls and performance benchmarks.

Illustration of goroutines flowing across processor queues in a Go service

Goroutine Scheduling in Go: Inside the Runtime That Powers Production Services

Understanding Go’s scheduler is essential for writing low‑latency, high‑throughput services. This article walks through the GMP model, context switching, and real‑world tuning levers.