The Storage Hierarchy¶

Storage forms a hierarchy where faster storage is more expensive per byte, creating a multi-level caching system where each layer serves as a cache for the layer below it.

Tension Addressed¶

Space vs. Time in Storage

Recognizable As¶

Any tiered storage system, cache eviction policies, memory-mapped files, buffer pools in databases, CDN edge caching, "hot" vs "cold" data classification

Canonical Sources¶

Patterson & Hennessy, "Computer Architecture: A Quantitative Approach"; Denning, "The Working Set Model for Program Behavior" (1968)

Transfers To¶

Memory management, web caching (CDNs), database buffer management, distributed caching, archive storage design

Sub-concepts: - Working set: The subset of data actively in use at any time - Cache hit ratio: The effectiveness measure of any caching layer - Cache replacement policies: LRU, LFU, and variations navigate recency vs. frequency