Build a real GGUF parser and tensor loader from scratch in Rust — metadata parsing, q4_0/q8_0 dequantization, mmap’d weight streaming, and a minimal Llama forward pass. The kind of CV project that gets interviews at systems and ML infra teams.
Liter-LLM re-imagines multi-provider LLM orchestration by putting a Rust runtime behind a clean Python API. This deep dive walks through its architecture, the PyO3 polyglot bindings, and the patterns for building production-grade AI pipelines.
Build a runnable LSM-tree key-value store with a write-ahead log in Rust, from WAL append to SSTable flush to compaction. The exact project to make your CV read like a database engineer’s.
A step‑by‑step guide to designing a Rust inference engine, exposing it to multiple languages, and wiring it into a fault‑tolerant, observable production workflow.
Explore the Rust‑centric architecture, FFI patterns, and scaling tricks that let you serve multiple LLM providers from a single, high‑performance service.