Memory-Management

COW lets the OS clone a process in microseconds by postponing actual copying, a technique that underpins containers, virtualization, and high‑performance servers.

Copy‑on‑write lets multiple processes reference the same memory until a write occurs, dramatically reducing duplication and improving performance. This post explains the mechanics, real‑world implementations, and trade‑offs.

Copy‑on‑write avoids costly memory allocation by sharing data until a write occurs, dramatically improving throughput in many systems.

Introduction Memory allocation is one of the most fundamental operations in any software system, from low‑level kernels to high‑performance graphics engines. While the classic malloc/free pair works well for general‑purpose workloads, modern applications often demand predictable latency, minimal fragmentation, and tight control over allocation size. This is where block sub‑allocation comes into play. Block sub‑allocation (sometimes called sub‑heap, region allocator, or memory pool) is a technique where a large contiguous block of memory—often called a parent block—is obtained from the operating system (or a lower‑level allocator) and then internally sliced into many smaller pieces that are handed out to the application. By managing these slices yourself, you can: ...

Table of Contents Introduction Fundamentals of Fragmentation 2.1 External vs. Internal Fragmentation 2.2 Why Fragmentation Matters Types of Defragmentation 3.1 Memory (RAM) Defragmentation 3.2 File‑System Defragmentation 3.3 Flash/SSD Wear‑Leveling & Garbage Collection Classic Defragmentation Algorithms 4.1 Compaction (Sliding‑Window) 4.2 Mark‑Compact (Garbage‑Collector Style) 4.3 Buddy System Coalescing 4.4 Free‑List Merging & Best‑Fit Heuristics Modern & SSD‑Aware Approaches 5.1 Log‑Structured File Systems (LFS) 5.2 Hybrid Defrag for Hybrid Drives 5.3 Adaptive Wear‑Leveling Algorithms Algorithmic Complexity & Trade‑offs Practical Implementation Considerations 7.1 Safety & Consistency Guarantees 7.2 Concurrency & Locking Strategies 7.3 Metrics & Monitoring Case Studies 8.1 Windows NTFS Defragmenter 8.2 Linux ext4 & e4defrag 8.3 SQLite Page Reordering 8.4 JVM Heap Compaction Performance Evaluation & Benchmarks Future Directions 11 Conclusion 12 Resources Introduction Fragmentation is a silent performance killer that plagues virtually every storage medium and memory manager. Whether you are a systems programmer, a database engineer, or a hobbyist tinkering with embedded devices, you will inevitably encounter fragmented memory or files. Defragmentation algorithms—sometimes called compaction or consolidation algorithms—are the tools we use to restore locality, reduce latency, and extend the lifespan of storage media. ...